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MISSION 


To  support  the  Air  Force  Mission, 
Air  Force  Commanders, 
and  Air  Force  Personnel 

Through  Air  Force  Systems  Command 

By  Technology  Base  R&D 

In  the  Technology  Areas  of 

Manpower  and  Personnel 
Education  and  Training 
Simulation  and  Training  Devices 
Logistics  and  Human  Factors 


ORIGIN 

In  the  late  1960s,  the  Secretary  of  the  Air  Force  and  the  Air  Force  Chief  of  Staff  decided  to 
redefine  the  Air  Force's  research  and  development  (R&D)  efforts  In  the  related  areas  of  personnel 
and  training.  In  August  1967,  the  augmented  Psychology  and  Social  Sciences  Panel  of  the  USAF 
Scientific  Advisory  Board  conducted  a  study  concerning  such  R&D  work.  In  Its  report,  the  board 
developed  certain  standards  needed  for  a  successful  program:  (a)  the  requirement  for  managers 
of  these  R&D  efforts  to  possess  and  display  a  keen  Interest  In  the  entire  program,  (b)  the  proper 
allocation  of  sufficient  funding  commensurate  to  the  work  being  accomplished,  (c)  the  acquisition 
and  retention  of  well-trained  and  highly  qualified  people,  (d)  the  recognition  that  the  "human 
factor*  Involved  In  personnel  and  training  R&D  makes  It  a  unique  entity  that  cannot  be  compared 
to  the  hardware  R&D  In  the  Air  Force's  respective  physical  science  laboratories,  (e)  the  need  for 
R&D  functions  to  be  geographically  close  to  the  organizations  that  most  effectively  applied  the 
results  of  that  R&D  work,  and  (f)  the  need  for  a  proper  balance  between  finding  solutions  to 
current  problems  and  the  achievement  of  long-range  R&D  goals.  On  July  1,  1968,  the  Air  Force 
Human  Resources  Laboratory  (AFHRL)  was  established  with  an  organizational  structure  that  has 
allowed  It  to  effectively  carry  out  Its  mission  over  the  last  17  years. 


“Military  power... serves  the  cause  of  peace  by  holding 
up  a  shield  behind  which  the  patient,  constructive  work 
of  peace  can  go  on.”  Dwight  D.  Eisenhower 
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The  Air  Force  Human  Resources  Laboratory  con¬ 
ducts  research  and  development  ( R&D }  In  all 
areas  of  people-related  Air  Force  needs.  Our 
Laboratory  Is  committed  to  providing  the  tech¬ 
nology  base  and  applications  which  will  match 
technologically  advanced  weapon  systems  with 
appropriately  skilled  personnel,  both  military 
and  civilian.  Reading  the  newspaper  on  almost 
any  given  day  makes  us  acutely  aware  of  the 
urgency  of  our  task  to  uphold  the  combat  readi¬ 
ness  of  the  U.S.  Air  Force.  Hostile  forces  are 
real  and  bent  on  destroying  the  blessings  of  our 
way  of  life.  As  members  of  the  Air  Force,  and 
as  civilian  employees  of  the  Department  of 
Defense,  we  together  with  our  sister  Services 
are  charged  with  providing  our  Nation's  defense. 
This  prompts  us  to  a  strong  sense  of  stewardship 
--to  provide  the  highest  level  of  productivity 
and  technology  development  of  which  we  are  cap- 
able--to  make  the  maximum  contribution  to  the 
fighting  strength  of  the  Air  Force. 


This  annual  report  highlights  some  of  the  fea¬ 
tures  of  our  organization,  major  programs, 
resources,  and  products.  We  Invite  you  to  visit 
with  us  through  this  report,  and  to  become  bet¬ 
ter  acquainted  with  AFHRL. 

Those  of  you  who  have  seen  our  previous  Annual 
Reports  will  note  that  this  year’s  report  has 
been  greatly  modified.  It  has  been  designed  to 
provide  an  update  to  the  activities  found  in  the 
FY84  Annual  Report  and  to  provide  a  more  timely 
product.  Please  let  us  know  whether  this 
report  better  serves  your  needs. 


DENNIS  W.  JARVI, 
Commander 


fldnel,  USAF 
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Colonel  Michael  C.  Lane 
Vice  Commander 


EXECUTIVE  SUPPORT  OFFICE 

The  Executive  Support  Office  develops  and  Imple¬ 
ments  policies,  procedures,  and  standards  relat¬ 
ing  to  administration  management  and  practices, 
military  and  civilian  personnel  and  manpower 
actions,  and  materiel  actions.  The  Office  pro¬ 
vides  staff  guidance,  assistance,  and  surveil¬ 
lance  over  other  echelons  In  areas  of  functional 
res  onslbillty  for  the  Laboratory  Commander. 

The  Office  Staff  operates  the  following 
programs:  manpower  and  organization,  reports 
management,  document  security,  military  and 


Captain  Neena  R.  Wright 
Director,  Executive  Support  Office 


civilian  personnel  administration  (Including 
training  programs),  and  organizational  supply. 
Further,  the  Executive  Support  Office  Is  the 
principal  focal  point  for  host-tenant  support 
agreements  for  the  Laboratory  and  represents  the 
Laboratory  In  dealings  with  other  agencies  and 
higher  headquarters  In  all  areas  of  functional 
responsibilities,  and  serves  as  focal  point  for 
Inspector  General  visits  and  reports. 


Dr.  Herbert  J.  Clark 
Director,  Plans  and  Programs  Office 


PLANS  AND  PROGRAMS  OFFICE 

The  Plans  and  Programs  Office  plans.  Implements, 
and  monitors  the  execution  of  the  AFHRL  RAD 
program.  The  Office  performs  long-range  plan¬ 
ning,  including  front-end  analyses,  that  com¬ 
bines  higher  headquarters  guidance.  Air  Force 
user  requirements,  and  technological  opportun¬ 
ities.  The  Office  Staff  evaluates  Independent 
Research  and  Development  projects  of  Industry, 
tracks  Laboratory  accomplishments,  and  prepares 
technology  transition  plans.  Office  personnel 
publish  all  planning  documents  and  prepare  all 
budget  submissions  to  higher  headquarters.  The 
Office  effects  program  Implementation  by  pro¬ 
cessing  all  financial  and  budgetary  documents. 
It  monitors  progress  of  all  support,  contrac¬ 
tual,  and  In-house  efforts,  and  provides 
resource  management  required  to  execute  an 
effective  RAD  program. 
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MANPOWER  AND  PERSONNEL  DIVISION 


* 


Selecting  the  most  qualified  applicants  and 
placing  them  In  the  right  jobs  are  essential  to 
maintaining  a  combat-ready  Air  Force.  To  sus¬ 
tain  an  enlisted  strength  of  over  485,000  and 
an  officer  corps  of  106,000,  the  Air  Force  must 
access  a  large  number  of  relatively  untrained 
Individuals.  In  fact,  some  65,000  new  airmen 
are  brought  Into  the  Air  Force  each  year  and 
matched  with  jobs  in  245  career  fields.  To 
keep  the  officer  force  fully  manned  requires 
some  9,000  new  officers  yearly  for  jobs  In  235 
career  fields.  Matching  of  people  and  jobs 
continues  beyond  Initial  accession  since  each 
year  over  10,000  enlisted  members  change  career 
fields. 

To  be  an  effective  fighting  force,  not  only 
must  the  newly  accessed  members  be  trained  In 
their  jobs  but  also,  the  entire  force  must  con¬ 
tinue  to  train  to  stay  proficient  In  their 
skills.  Each  year  125,000  enlisted  members  at¬ 
tend  formal  training  and  many  more  participate 
In  on-the-job  training  to  retain  and  Increase 
job  skills  and  abilities.  Initial  and  subse¬ 
quent  training  of  officers  also  comprises  a 
significant  portion  of  officer  force  manage¬ 
ment.  For  pilots  and  navigators  alone,  1,600 


Colonel  Ronald  L.  Kerchner 
Division  Chief 


Dr.  Nancy  Guinn  Vltola 
Technical  Director 

new  pilots  and  750  new  navigators  are  trained 
each  year.  Of  the  30,000  experienced  rated 
officers,  virtually  all  who  are  performing  fly¬ 
ing  duties  participate  In  some  form  of  training 
each  year.  Costs  of  this  training  are  substan¬ 
tial.  For  example,  an  FB-111  pilot  costs  over 
$1.3  million  and  the  navigator  for  the  same 
weapon  system  costs  over  $700,000.  Enlisted 
courses  range  from  a  few  thousand  dollars  per 
graduate  to  almost  $100,000  for  certain  avionics 
technicians. 

Selection,  classification,  and  training  are  all 
part  of  force  management  which  Incorporates 
other  aspects  such  as  performance  evaluation, 
promotion,  and  retention.  At  nearly  $20  billion 
yearly.  Air  Force  military  personnel  costs  are 
a  major  budget  Item  requiring  effective  force 
management  to  ensure  the  Air  Force  gets  the  most 
for  Its  Investment. 

The  Manpower  and  Personnel  Division  directs  a 
comprehensive  and  long-term  R&D  program  to  de¬ 
velop  the  tools,  procedures,  and  associated 
technologies  to  ensure  more  effective  use  of 
personnel  resources.  Specific  RSD  programs  are 
designed: 

1.  To  Improve  personnel  evaluation 
techniques. 
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2.  To  determine  appropriate  job  assessment 
procedures. 

3.  To  provide  Air  Force  manpower  and  per¬ 
sonnel  managers  with  new  management  decision 
aids. 


B4TTEx£TlTut>E 
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PERSONNEL  EVALUATION 


The  Air  Force  Human  Resources  Laboratory  is 
tasked  by  Air  Force  Regulation  35-8  to  provide 
valid  instruments  for  both  entry  selection  and 
job  classification  of  Air  Force  officer  and 
enlisted  members.  In  addition,  a  Joint-Services 
regulation  (Air  Force  Regulation  33-6)  desig¬ 
nates  the  Laboratory  as  the  Joint-Services  lead 
for  R&D  on  the  Armed  Services  Vocational  Ap¬ 
titude  Battery  (ASVAB),  which  is  used  000-wide 
for  enlisted  selection  and  classification.  The 
major  instrument  for  Air  Force  officer  acces¬ 
sioning  and  classification  is  the  Air  Force 
Officer  Qualifying  Test  (AFOQT).  In  addition 
to  these  two  major  test  programs,  the  Laboratory 
is  respoisible  for  developing  several  special- 
purpose  tests,  such  as  the  Electronic  Data  Pro¬ 
cessing  Test  (EDPT). 

Enlisted  and  officer  selection  and  classifica¬ 
tion  tests  must  be  developed  such  to  ensure  that 
the  best  available  civilian  talent  is  enlisted 
or  commissioned  into  the  Air  Force  and  that 
there  is  an  optimal  match  between  their  talent 
and  the  jobs  to  be  performed.  Yearly  accessions 
vary  dramatically  in  terms  of  ability  to  acquire 
new  skills.  It  is  important  that  selection 


instruments  incorporate  the  latest  theory  and 
analytical  approaches  to  ability  testing  to 
enhance  information  about  the  examinees'  pro¬ 
pensity  for  success  in  the  military.  Toward 
this  end,  the  Laboratory  conducts  psychometric 
research  ranging  from  exploration  of  new  com¬ 
puter-based  measures  to  broaden  ability  coverage 
in  testing  beyond  that  achievable  via  paper-and- 
pencil  tests  to  investigation  of  computer 
adaptive  test  technology  through  development  of 
new  prototypes  of  paper-and-penc i  1  instruments 
and  development/maintenance  of  new  forms  of 
existing  operational  selection  and  classifica¬ 
tion  batteries.  Associated  materials  (e.g., 
manuals,  technical  data,  norms)  for  effective 
standardized  use  in  the  operational  testing 
programs  must  also  be  developed.  Aircrew  selec¬ 
tion  procedures  receive  special  emphasis  due  to 
the  extremely  high  costs  of  training  pilots  and 
navigators  and  the  key  role  these  personnel  have 
in  maintaining  combat  readiness.  The  paragraphs 
which  follow  summarize  1985  activity  in  this 


Learning  Abilities  Measurement  Program 

The  Learning  Abilities  Measurement  Program 
(Project  LAMP)  is  a  major  research  effort, 
sponsored  by  the  Air  Force  Office  of  Scientific 
Research,  investigating  the  computerized 
measurement  of  human  information  processing 
abilities.  While  the  project  is  devoted  to 
basic  research,  it  is  nevertheless  goal 
oriented.  A  major  goal  is  to  develop  new  tests 
for  inclusion  in  future  personnel  selection  and 
classification  programs  that  measure  how 
individuals  think,  remember,  solve  problems. 


and  acquire  knowledge  and  skills.  Project  LAMP 
capitalizes  on  the  capabilities  of  microcompu¬ 
ters  to  measure  abilities  not  easily  evaluated 
by  paper-and-pencl 1  tests.  Among  the  candidates 
for  investigation  are  information  processing 
speed  (associated  with  such  processes  as  encod¬ 
ing,  comparing,  choosing,  retrieving  from  mem¬ 
ory,  memory  searches,  etc.);  attentional  re¬ 
sources;  attentional  shifts;  working  memory 
capacity;  efficiency  of  movement  toward  auto- 
maticity;  visual  and  auditory  memory;  knowledge 
organization;  and  abilities  to  handle  multitask¬ 
ing.  Plans  call  for  evaluation  of  these  new 
measures  in  terms  of  their  ability  to  predict 
subsequent  learning  and  performance  behaviors 
measured  under  laboratory  conditions.  This 
research  recognizes  and  addresses  the  problem 
of  a  25-year  stagnation  in  the  state  of  the  art 
in  ability  measurement.  It  is  expected  to  lead 
to  a  new  generation  of  tests  that  will  provide 
information  on  many  important  abilities  not 
currently  evaluated  by  ASVAB. 


Enlisted  Test  Programs 


The  ASVA8  is  the  primary  enlisted  selection  and 
classification  test  for  all  the  Military  Ser¬ 
vices  and  the  Coast  Guard.  Each  year.  It  Is 
administered  to  more  than  2  million  persons 
nationwide.  The  Laboratory  must  develop  new 
forms  of  the  ASVAB  both  for  production  testing 


provide  supporting  research  for  both  programs. 
This  year  the  Laboratory  fulfilled  one  of  its 
primary  test  development  responsibilities  with 
the  successful  implementation  of  ASVAB  Forms  11, 
12,  and  13  in  the  new  1980  youth  population 
score  scale.  The  Initial  operational  test  and 
evaluation  of  those  new  forms  has  begun.  Suc¬ 
cessful  resolution  of  issues  surrounding  test 
performance  differences  on  the  speeded  ASVAB 
subtests,  due  to  printing  differences,  was 
achieved.  In  support  of  the  enlistment  testing 
program,  studies  were  completed  which  establish¬ 
ed  deliberate  failure  keys  (for  mobilization 
backup)  for  the  newly  Implemented  tests. 
Another  study  examined  possible  alternative 
forms  of  the  Armed  Forces  Qualification  Test 
(AFQT),  which  is  the  joint-Services  qualifica¬ 
tion  measure  of  the  ASVAB.  Items  for  the 
follow-on  forms  of  the  ASVAB  to  be  implemented 
in  1987  were  developed  and  experimentally  tested 
at  the  Air  Force  Recruit  Training  Center  at 
Lackland  AFB,  as  were  the  test  items  to  be  used 
for  the  follow-on  versions  of  the  ASVAB  used  in 
the  DOD  Student  Testing  Program.  In  fulfilling 
necessary  R&D  support  for  the  DOD  Student  Test¬ 
ing  Program,  a  technical  supplement  was  devel¬ 
oped  for  the  Counselor  Manual  used  by  school 
counselors  in  the  nation's  high  schools.  Addi¬ 
tionally,  work  was  begun  on  the  occupational 
validation  of  the  Student  Testing  ASVAB.  This 
large  effort  will  validate  the  ASVAB-14  against 
job  performance  for  12  civilian  occupations. 
Results  will  enhance  the  ability  of  school 
counselors  to  guide  the  occupational  choice  of 
high  school  students. 

Officer/Civilian  Test  Programs 

The  Manpower  and  Personnel  Division  conducts 
R&D  pertaining  to  the  development  and  validation 
of  Instruments/procedures  used  for  officer 
selection,  classification,  and  career  develop¬ 
ment.  During  FY85,  R&D  was  conducted  to  main¬ 
tain,  validate,  and  Improve  the  Air  Force 
Officer  Qualifying  Test  (AFOQT).  Approximately 
4,500  experimental  items  in  various  cognitive 
ability  areas  were  written,  arranged  in  test 
booklets,  and  pretested  at  Lackland  AFB.  Test 
scoring  and  preliminary  Item  analysis  activities 
have  been  completed.  Work  to  Identify  the  best 
experimental  items  has  begun.  These  Items  will 
be  evaluated  as  candidates  for  operational  use 


and  for  the  DOD  Student  Testing  Program  and  must  in  the  upcoming  AFOQT  Form  P.  Plans  were 
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formulated  to  produce  and  evaluate  an  addi¬ 
tional  4,000  items  in  FY86,  primarily  for  use  in 
subsequent  versions  of  the  test.  In  addition, 
an  investigation  that  will  validate  the  AFOQT 
against  several  relevant  criteria  has  begun. 
Validation  against  technical  training  school 
criteria  has  been  completed,  and  plans  have  been 
formulated  to  validate  the  instrument  against 
job  performance  and  officer  effectiveness  cri¬ 
teria.  Research  activities  also  involve  other 
instruments  and  procedures  related  to  selection 
and  classification  of  officers  and  civilians. 
English  language  tests  have  been  field  tested 
at  overseas  bases.  Data  from  this  investigation 
will  be  used  to  improve  these  tests  before  they 
are  used  by  civilian  personnel  officers  in  the 
selection  and  placement  of  foreign  nationals 
working  at  overseas  air  bases.  In  addition, 
work  is  ongoing  to  validate  the  Officer  Training 
School  (OTS)  and  Air  Force  Reserve  Officer 
Training  Corps  (AFROTC)  selection  systems. 
These  two  selection  processes  are  being  com¬ 
pared.  Each  system  will  be  validated  against 
performance  criteria  obtained  prior  to  commis¬ 
sioning  and  at  several  points  during  the  career 


cycle.  Officer  research  goals  and  activities 
have  been  reviewed  and  revised.  Research  per¬ 
taining  to  current  and  future  forms  of  the 
AFOQT  will  continue  to  be  emphasized.  However, 
R&D  activities  will  be  broadened,  with  more 
emphasis  placed  on  classification  and  career 
development  Instruments  and  procedures. 

Aircrew  Selection  Programs 

Selection  for  Pilot  Training  -  At  the  request 
of  Air  Training  Command  (ATC),  an  analysis  of 
the  Flight  Screening  Program  (FSP)  was  com¬ 
pleted.  FSP  is  the  light-aircraft  training 
program  given  to  applicants  who  have  had  no 
previous  flying  experience  ( i . e . ,  private 
pilot's  license).  The  results  were  briefed  to 
ATC  and  submitted  for  publication  as  a  technical 
report.  It  was  found  that  FSP  had  a  positive 
effect  in  lowering  Undergraduate  Pilot  Training 
(UPT)  attrition,  but  this  effect  was  due  mainly 
to  the  training  received  during  FSP  rather  than 
to  the  screening  which  occurred.  One  group  of 
subjects  sampled  received  an  extra  6  hours  of 
FSP  training  and  had  a  much  lower  attrition  rate 
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than  those  receiving  the  norma?  FSP  program. 
Additional  recommendations  were  made  to  enhance 
the  screening  performance  of  the  FSP  by  inte- 
grating  available  student  performance  data  with 
psychomotor  testing.  Field  testing  of  the 
Integrated  Selection  System  began  in  September 
1985  and  is  expected  to  be  completed  in  early 
1987.  Parallel  work  continued  on  AFROTC  candi¬ 
dates  for  UPT  with  testing  of  cadets  at  the 
Lackland  AFB  summer  camp.  An  Integrated  system 
comparable  to  the  FSP  model  will  be  developed 
when  a  sufficient  number  of  ROTC  students  have 
graduated  from  UPT  to  support  a  data  analysis. 
An  operational  methodology  for  employment  of 
psychomotor  tests  was  established. 

Selection  for  Navigator  Training  -  The  develop¬ 
ment  of  a  Basic  Navigator  Battery  continued  with 
the  completion  of  an  interim  report  analyzing 
the  combined  validity  of  the  Basic  Navigator 
Battery  and  the  AFOQT  for  reducing  attrition  in 
Undergraduate  Navigator  Training.  R&D  continues 
on  development  of  navigator  tests  for  opera¬ 
tional  use. 

Track  Selection  for  Specialized  Undergraduate 
Pilot  Training  -  In  a  joint  effort  with  the 
AFHRl  Operations  Training  Division,  a  computer¬ 
ized  data  retrieval  system  Is  being  installed 
in  the  Air  Combat  Maneuvering  Instrumentation 
( ACM  I )  range  at  Luke  AFB.  This  system  will 
provide  "real  world"  performance  data  from  live 
air-to-air  engagements  to  establish  criteria 


for  selections  into  the  Fighter/Attack/Reconna¬ 
issance  (FAR)  track  of  the  proposed  Specialized 
Undergraduate  Pilot  Training  (SUPT)  pilot 
training  program.  The  system  being  installed 
at  Luke  AFB  is  scheduled  to  be  operational  in 
June  1986,  when  PMS  research  enters  the  data- 
gathering  phase.  Performance  data  from  the  FSP, 
UPT,  Lead-In  Fighter  Training  (LIFT)  and  Combat 
Crew  Training  Units  (CCTUs)  training  continued 
to  be  integrated  into  the  research  database  for 
development  of  pilot  performance  criteria. 
These  criteria  will  be  used  in  development  of 
systems  for  accessions  into  UPT  and  assignment 
into  the  FAR  track  or  Tanker/  Transport/Bomber 
(TTB)  training  track  of  SUPT.  This  database 
supported  limited  analyses  during  1985  but  will 
not  contain  enough  subjects  who  have  completed 
all  phases  of  pilot  training  until  1988  to  con¬ 
duct  definitive  analyses. 

INTEGRATED  SYSTEM  DEVELOPMENT 


ADVANTAGES:  BEST  MIX  OF  SIGNIFICANT  PREDICTORS 
MAXIMIZE  PREDICTION  OF  UPT  SUCCESS 


Euro-NATO  Joint  Jet  Training  Program  (ENJJPT)  - 
A  preliminary  analysis  comparing  the  performance 
of  ENJJPT  graduates  with  that  of  USAF  UPT 
graduates  was  completed  In  late  FY85.  Initial 
findings  reflected  little  difference  In  the 
performance  of  graduates  of  the  two  training 
programs,  based  on  grades  from  LIFT.  A  more 


detailed  examination  of  CCTU  and  ACMI  perfor¬ 
mance  wlH  follow  In  FY86. 

JOB  ASSESSMENT 

A  wide  range  of  measurement  technologies  are 
necessary  for  Air  Force  manpower,  personnel, 
and  training  (MPT)  managers  to  effectively  set 
and  Implement  force  structure  and  utilization 
policy.  Job  assessment  research  concentrates 
on  Identifying  the  characteristics  and  personnel 
requirements  of  jobs  and  also  the  measurement 
of  how  Individuals  and  groups  of  Individuals 
perform  those  jobs.  Measures  of  jobs  are  used 
by  the  Air  Staff  to  monitor  and  realign  the 
system  for  organizing  and  classifying  jobs  into 
specialties  and  for  determining  the  numbers  and 
characteristics  of  personnel  to  be  assigned  to 
the  specialties.  The  job  classification  struc¬ 
ture,  which  presently  contains  235  separate 
career  fields,  governs  all  phases  of  personnel 
acquisition  and  utilization.  Individual  career 
fields  have  different  recruiting  quotas,  entry 
standards,  technical  training  programs,  assign¬ 
ment  options,  promotion  criteria  and  reenllst- 
ment  goals.  Air  Training  Command  uses  the  job 
measures  to  Identify  training  requirements  and 
to  ensure  that  training  matches  the  tasks  per¬ 
formed  on  the  job.  Air  Force  Initial  skills 
training  alone  costs  $400  million  annually  to 
administer.  Basic  Job  Skills  and  Aptitude 
Requirements  were  two  major  FY85  research 
efforts  aimed  at  providing  technologies  for 
measuring  job  and  training  requirements. 

Measures  of  how  well  Individuals  and  groups 
perform  their  jobs  provide  the  other  side  of  the 
MPT  Job  assessment  needs.  Measures  of  how  well 
Individuals  can  perform  their  jobs  are  essential 
If  MPT  policymakers  and  planners  are  going  to 
be  able  to  evaluate  the  bottom  line.  These 
measures  must  show  whether  the  classification 
structures,  aptitude  standards,  training  sys¬ 
tems,  and  personnel  policies  and  procedures  are 
effective  in  getting  the  current  job  done  while 
ensuring  that  the  personnel  could  meet  war  time 
demands  If  called  upon  to  do  so.  In  FY85,  two 
major  research  efforts  were  aimed  at  providing 
those  job  performance  measures:  Job  Perfor¬ 
mance  Measurement  and  Productivity  Research. 


Basic  Job  Skills 

The  Increasing  complexity  of  modern  weapons 
systems  and  the  resulting  need  for  highly 
trained  maintenance  personnel  have  led  to  a 
comprehensive  evaluation  of  what  skills  are 
necessary  to  become  proficient  In  today's  tech¬ 
nologically  sophisticated  workplace.  The  basic 
job  skills  RAD  program  focuses  on  three  related 
objectives:  1)  determining  what  basic  skills 
are  required  on  Air  Force  jobs,  2)  assessing 
capabilities  of  personnel  assigned  to  perform 
them,  and  3)  developing  training  programs  that 
accelerate  acquisition  of  needed  technical 
skills.  For  purposes  of  this  RAD,  basic  skills 
are  defined  as  the  core-knowledge  and  knowledge- 
activating  processes  that  are  common  to  gaining 
proficiency  in  a  number  of  related  job  families. 
The  analysis  is  concentrating  on  125  Air  Force 
specialties.  Task  analysis  methods  are  being 
developed  to  capture  behavioral  as  well  as 
cognitive  skill  requirements  in  a  broad  range 
of  occupational  categories.  Among  the  training 
delivery  options  being  explored  are  intelligent 
computer-assisted  instructional  systems  which 
interact  with  the  learner  to  diagnose  skill 
deficiencies  and  provide  expert  assistance  in 
completing  course  objectives.  The  results  of 
this  work  should  enable  first-term  personnel  to 
gain  proficiency  quicker  on  a  broader  range  of 
complex  technical  skills.  During  FY85,  Initial 
investigations  were  successfully  completed  which 
led  to  Initiation  of  the  full-scale  RSD  program. 

Aptitude  Requirements 

A  measurement  technology  now  under  development 
employs  experts'  ratings  of  task  learning  dif¬ 
ficulty  to  produce  an  occupational  level-of- 
learning  difficulty  that  can  be  meaningfully 
compared  across  occupations.  The  technology  is 
based  on  the  occupational  analysis  procedure 
Implemented  by  the  Air  Force  Occupational 
Measurement  Center  (AFOMC),  although  It  repre¬ 
sents  a  significant  extension  and  enhancement 
of  this  procedure.  The  Occupational  Learning 
Difficulty  Index  has  been  proposed  for  use  In  a 
wide  range  of  management  decisions  concerning 
the  classification  and  training  of  enlisted 
personnel.  First,  the  Index  can  be  applied  to 
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determine  job  aptitude  requirement  minimums 
stated  in  Air  Force  Regulation  39-1.  This 
would  ensure  that  the  highest  aptitude  require¬ 
ment  minimums  are  specified  for  job  specialties 
highest  In  learning  difficulty.  Second,  the 
index  can  be  used  within  the  computer-based, 
person- job-match  system  to  determine  initial 
job  offers  for  Air  Force  enlistees.  The  pur¬ 
pose  of  this  application  is  to  ensure  that 
enlistees  having  the  highest  aptitudes  are 
offered  specialties  highest  in  learning  d if— 
ficulty.  Finally,  the  index  can  be  referenced 
for  the  purpose  of  identifying  the  most  appro¬ 
priate  mode  of  training  (i.e.,  classroom  or 
on-the-job  training)  for  enlisted  skills. 

Job  Performance  Measurement 

The  Air  Force  began  a  long-term  R&D  effort  in 
FY83  to  systematically  obtain  job  performance 
measures  that  will  serve  as  criteria  for  vali¬ 
dating  selection  systems  and  for  evaluating 
training  programs  and  the  effects  ,f  personnel 


policies  and  procedures.  The  technology  is 
also  necessary  to  meet  a  Congressional  mandate 
to  validate  enlisted  selection  tests  against 
job  performance  measures  rather  than  training 
outcomes. 

A  new  work  sample  methodology,  Walk-Through 
Performance  Testing  (WTPT),  is  the  basis  for 
this  developmental  effort.  This  methodology  is 
a  task-level  job  performance  measurement  system 
that  combines  on-site  evaluation  and  interview 
procedures  to  provide  a  high-fidelity  measure 
of  individual  task-oriented  capability.  A  wide 
range  of  alternative  and  more  cost-efficient 
job  performance  measures  have  been  developed  in 
addition  to  the  WTPT.  These  include  task- 
level,  dimensional,  global,  and  Air  Force-wide 
ratings  by  peers,  supervisors,  and  job 
incumbents. 

Job  performance,  WTPT,  and  rating  forms  data 
were  collected  on  approximately  300  first-term 
airmen  jet  engine  mechanics  (the  feasibility 


10 


MANAGEMENT  DECISION  AIDS 


test  specialty)  by  the  end  of  FY85.  The 
analyses  will  be  completed  In  early  FY86.  Job 
performance  measures  for  three  additional 
specialties  were  also  developed,  and  data 
collection  will  begin  in  FY86. 

Product  iv  ity 

Past  research  demonstrates  that  feedback,  goal 
setting,  and  incentives  improve  the  performance 
of  individuals  doing  simple  jobs.  These 
encouraging  results  suggested  this  R&D  to 
determine  the  effects  of  feedback,  goal 
setting,  and  incentives  on  the  productivity  of 
groups  performing  the  complex  jobs  typical  of 
the  work  done  in  operational  Air  Force 
organ  izat  ions.  In  addition,  this  effort  will 
suggest  a  solution  to  the  important  method¬ 
ological  problem  of  aggregating  productivity 
measures  from  lower  to  higher  organizational 
levels.  The  effort  has  four  major  objectives: 
(a)  to  field  test  the  general izab i I ity  of 

feedback,  goal  setting,  and  incentives  to 
operational  organizations;  (b)  to  determine  how 
much  these  enhancements  increase  productivity 
and  how  acceptable  they  are  to  Air  Force 
personnel;  (c)  to  design  detailed  procedures 

for  developing  and  aggregating  productivity 
indices;  and  (d)  to  develop  practical  manuals 
that  explain  how  managers  can  design  and 
implement  the  measurement  and  enhancement 
technologies. 

Two  specific  technologies  are  being  developed. 
The  first  measures  levels  of  productivity,  and 
the  second  enhances  productivity.  The  Method¬ 
ology  for  Generating  Efficiency  and  Effective¬ 
ness  Measures  (MGEEM)  has  successfully 
established  automated  productivity  measurement 
systems  in  two  field  test  organ izat ions .  MGEEM 
handbooks,  for  use  by  unit  level  personnel 

rather  than  by  professional  facilitators,  have 
been  developed  and  will  be  field  tested  in 

early  FY86.  MGEEM  has  also  been  used  to 
produce  productivity  baseline  data  and  post¬ 
test  data  in  two  units  where  a  prototype 
feedback  and  goal  setting  technology  was  field 
tested.  In  the  field  tests,  productivity 
increased  35  to  50  percent  over  a  5-month 
period  after  installation  of  a  goal  setting  and 
feedback  system.  A  non-monetary  incentive 
system  will  be  field  tested  in  FY86. 


Managing  a  complex  organization  requires  use  of 
sophisticated  decision  modeling,  analysis,  and 
simulation  capabilities  to  gain  both  an  effi¬ 
cient  and  effective  view  of  available  resources. 
At  the  entry  point,  information  gained  about 
personnel  qualifications  of  all  enlisted  acces¬ 
sions  must  be  considered  simultaneously  with  Air 
Force  job  requirements  to  produce  an  optimal  job 
placement.  Since  jobs  vary  considerably  in  what 
they  require,  as  do  job  applicants,  considerable 
leverage  can  be  gained  in  better  allocating 
available  talent  to  current  vacancies.  As  per¬ 
sonnel  progress  through  their  first  and  subse¬ 
quent  reenlistments,  they  gain  skills  and  exper¬ 
tise  which  enable  advancement  through  the  ranks. 
Promotion  systems  must  be  designed  to  select  the 
most  capable. 

Finally,  the  overall  force  structure  must  be 
maintained  in  equilibrium  to  avoid  personnel 
surpluses  or  shortages  which  could  be  costly  in 
the  event  of  mobilization.  Retention  is  a  key 
driver  of  the  entire  personnel  system,  not  only 
in  determining  the  number  of  replacements  needed 
but  also  in  terms  of  cost-avoidance.  Highly 
trained  and  experienced  personnel  are  very  cost¬ 
ly  to  replace.  Estimated  replacement  training 
costs  for  various  categories  of  maintenance 
personnel  range  from  $5000  to  more  than  $18,000. 
Highlights  of  the  Division's  operations  research 
and  statistical  modeling  program  are  summarized 
below. 

Person- Job-Match  Technology.  In  order  to  match 
people  and  jobs,  the  Person-Job-Match  (PJM) 
technology  uses  job  information  from  task  anal¬ 
ysis  and  information  about  each  individual's 
capabilities  and  desires  from  mental  tests, 
physical  examinations,  and  questionnaires.  The 
Procurement  Management  Information  System 
(PROMIS),  used  operationally  by  the  Recruiting 
Service  since  1976,  incorporates  PJM  technology 
to  select  and  classify  nonprior-service  person¬ 
nel.  The  Processing  and  Classification  of 
Enlistees  (PACE)  system  is  used  by  Air  Training 
Command  to  classify  approximately  50*  of  the  new 
recruits  who  were  assigned  only  to  broad 
occupational  areas  (Mechanical,  Administrative, 
General,  and  Electronics)  by  PROMIS. 


Current  R&D  Is  aimed  at  (a)  using  the  ASVAB 
subtest  scores  and  Vocational  Interest-Career 
Examination  (VOICE)  to  refine  data  available  In 
the  current  PROMIS  for  matching  people  and 
jobs,  (b)  replacing  the  current  sorting  process 
used  In  PACE  for  classification  with  a 
procedure  that  considers  all  possible 
assignments  and  picks  the  best  ones,  and  (c) 
designing  an  enhanced  PROMIS  system  which 
considers  more  variables  and  uses  more  advanced 
techniques  to  determine  the  best  POM. 

Weighted  Airman  Promotion  System  (MAPS).  The 
Weighted  Airman  Promotion  System  (WAPS)  Is  used 
In  promoting  enlisted  personnel  to  the  grades 
of  staff  sergeant,  technical  sergeant,  and 
master  sergeant.  The  system  consists  of  six 
promotion  selection  factors  (two  test  scores, 
two  seniority  factors,  one  decorations  score, 
and  one  job  performance  factor)  and  correspond¬ 
ing  weights  that  are  used  to  compute  a  total 
weighted-factor  promotion  score  for  each 
Individual  considered  for  promotion.  Each 
year,  counting  the  two  cycles  for  promotion  to 
staff  sergeant  and  one  cycle  each  for  promotion 
to  technical  sergeant  and  master  sergeant,  WAPS 
selects  approximately  45,000  people  for 
promotion  out  of  nearly  240,000  ellglbles. 

Since  WAPS  became  operational  In  1970,  ex¬ 
tensive  research  dealing  with  the  system  has 
been  conducted.  A  research  study  was  designed 
In  1985  to  address  the  following  objectives: 
(a)  develop  separate  weighted  formulas  for  each 
of  the  three  grades  within  WAPS,  (b)  consider 
the  completion  of  Command  Non-Commissioned 
Officer  Academy  as  an  additional  selection 
factor  for  promotion  to  E-7,  (c)  evaluate 
various  weighting  schemes  for  the  Airman 
Performance  Rating  (APR)  factor,  (d)  Inves¬ 
tigate  the  use  of  standardized  scores  for  the 
test  factors,  and  (e)  analyze  the  establishment 
of  a  separate  weighted  formula  for  those  Air 
Force  specialty  codes  which  have  no  Specialty 
Knowledge  Test  (SKT) . 

The  results  of  this  project  will  provide  Air 
Force  enlisted  promotion  policymakers  with  a 
current,  scientifically  defensible  basis  for 
making  Improvements  to  the  operational  WAPS  and 
will  enhance  the  goals  of  equitable  and  visible 
promotions.  This,  In  turn,  will  assure  that  the 
best  and  most  deserving  enlisted  personnel  are 
selected  for  promotion  to  the  Important  mid¬ 


level  grades  and  Impact  positively  on  retention 
rates,  quality  of  performance,  and  morale. 

Air  Force  Enlisted  Retention  Model.  An 
econometric  model  of  individual  reenlistment 
decisions  was  constructed  to  analyze  the  Impact 
of  demographic  variables  (e.g.,  education  and 
sex)  and  policy  variables  (e.g.,  bonus)  on  the 
retention  of  airmen  by  Air  Force  specialty 
(AFS).  The  model  was  developed  for  224  AFSs 
across  first,  second,  and  career  reenllstment 
decision  points.  To  support  model  development, 
a  large-scale  historical  airman  database  was 
constructed  to  represent  29  years  of  enlisted 
personnel  data.  Air  Force  pay  series  and  policy 
data,  and  related  civilian  pay  Information. 
The  results  of  the  econometric  analysis  have 
been  Incorporated  Into  the  Air  Force  Retention 
Analysis  Package  (AFRAP).  This  computer  model 
operating  on  an  IBM  personal  computer  allows 
the  user  to  estimate  the  Impact  of  changes  In 
the  econometric  model's  variables  on  re- 
enlistment  rates  by  AFS.  The  user  Is  also  able 
to  evaluate  how  these  changes  would  affect  the 
year-group  distribution  within  the  specialty. 

Products  from  this  research  have  been  used  by 
the  Air  Staff  Manpower  and  Personnel  Analysis 
Center  and  the  Bonus  Pay  Branch  In  the  Force 
Programs  Directorate.  The  Office  of  the 
Assistant  Secretary  of  Defense  supported  the 
purchase  of  the  AFRAP  software,  which  has  been 
demonstrated  to  personnel  managers  and 
researchers  in  each  Military  Service,  as  well 
as  to  other  Air  Staff  and  Air  Force  Manpower 
Personnel  Center  offices.  Results  of  the  model 
and  the  AFRAP  software  can  be  applied  to  pay 
and  bonus  decisions,  force  structure  analysis, 
and  retention  studies.  Work  continues  to 
refine  the  model  and  validate  the  econometric 
results. 

Comprehensive  Occupational  Data  Analysis 
Programs  (CODAP).  The  purpose  of  the  Compre¬ 
hensive  Occupational  Data  Analysis  Programs 
(CODAP)  Is  to  enhance  the  occupational  measure¬ 
ment  technology  that  supports  analyses  of  job 
structures,  entry-level  prerequisites,  training 
requirements,  and  specifications  for  enlisted 
promotion  tests.  The  current  occupational 
measurement  technology  began  20  years  ago  as  a 
software  system  of  approximately  15  general- 
purpose  programs.  However,  In  order  to  keep 
pace  with  the  rapidly  expanding  needs  of 
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occupational  researchers  and  analysts,  the 
system  was  forced  to  expand  unsystematically 
into  an  aggregate  of  more  than  60  general- 
purpose  programs.  Files  maintained  in  the 
system  were  put  in  a  variety  of  formats  and 
stored  on  a  variety  of  media  by  a  succession  of 
programmers  using  a  variety  of  programming 
standards  and  styles.  New  and  advanced 
developments  that  have  been  needed  in  the 
system  for  some  time  require  that  many  of  the 
existing  programs  run  more  efficiently  and 
interface  more  easily.  All  of  these  problems 
will  be  addressed  in  stages  as  part  of  the 
proposed  enhancement.  This  should  enable 
measurement  technology  to  stay  abreast  of 
advances  in  analysis  methodology  throughout  the 
remainder  of  this  decade  without  sacrificing 
system  maintainability  or  expandability. 


A  series  of  advanced  development  tasks  has  been 
initiated  to  restructure  the  CODAP  system  and 
organize  recent  changes  to  the  system  to  enhance 
its  efficiency,  maintainability,  and  versatili¬ 
ty.  One  objective  is  to  improve  and  standardize 
the  current  occupational  analysis  procedures  and 
to  generate  efficiencies  in  the  analysis  process 
that  will  improve  the  quality  of  the  products 
with  significantly  less  expenditure  of  scientist 
and  analyst  work-hours  and  computer  processing 
time.  The  second  objective  of  this  effort  is 
to  provide  thorough,  consistent  documentation 
that  will  permit  programmers  and  programming 
technicians  to  operate  and  debug  the  system 
without  excessive  expenditures  of  time  and 
effort.  The  restructured  occupational  measure¬ 
ment  software  system  (designated  ASCII  CODAP) 
was  delivered  at  the  end  of  FY85. 


OCCUPATIONAL  MEASUREMENT  TECHNOLOGY  (63704F  -  PROJECT  2948) 

ADVANCED  CODAP  SOFTWARE 
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Training  Decisions  System.  A  basic  problem  in  where  tasks  should  be  trained,  and  to  what 

developing  overall  training  plans  for  Air  Force  proficiency  levels;  (b)  for  considering 

career  ladders  is  deciding  what  to  train  optional  patterns  ot  airman  utilization;  (c) 

(training  content  decision),  where  to  train  for  estimating  cost  and  resource  capacity 

(appropriate  settings),  and  when  to  train  (at  consequences  of  utilization  and  training 

various  points  throughout  an  airman's  career).  alternatives;  and  (d)  for  integrating  the  first 

Because  of  the  scope  and  complexity  of  Air  three  subsystems  and  seeking  optimal  training 

Force  training,  many  decisions  with  major  solutions, 

impacts  on  training  are  made  independently  by 

management  without  the  benefit  of  coordination  Currently,  task  clustering  techniques  are  being 

and  relevant  data.  considered  with  Inputs  from  subject-matter 

experts,  career  ladder  identification  is  being 
The  Training  Decision  System  (TDS)  is  being  validated,  and  cost/resource  capacity  data  are 

developed  to  provide  a  more  unified,  practical,  being  gathered  for  two  of  four  Air  Force 

integrated  approach  to  training  problems.  All  specialties.  The  other  two  specialties  will  be 

relevant  data  will  be  considered  at  once  for  considered  in  the  near  future.  A  transition 

decision  making.  The  interactive,  computer-  plan,  outlining  implementation  plans  and  user 

based  system  will  aid  decision  makers  by  training  requirements,  has  been  formulated, 

developing  four  subsystems:  (a)  for  determining 


TRAINING  DECISIONS  SYSTEM  (TDS) 


Further  Information  on  any  of  these  projects  is  available 
from  the  points  of  contact  listed  on  page  80. 
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OPERATIONS  TRAINING  DIVISION 

The  Operations  Training  Division  of  AFHRL  has  a 
unique  role  as  the  only  Air  Force  agency  devoted 
to  the  exploitation  of  science  and  technology 
to  Improve  aircrew  training.  The  Division's  R&D 
programs  dynamically  contribute  to  the  effec¬ 
tiveness  and  efficiency  of  operational  training 
throughout  the  Air  Force.  Formed  In  1969  as 
that  Integral  part  of  the  AFHRL  responsible  for 
flying  training,  the  Operations  Training  Divi¬ 
sion  performs  Its  mission  through  two  primary 
functions:  (a)  behavioral  R&D  to  solve  flying 
training  problems  through  improved  technology 
and  (b)  engineering  R&D  to  develop  devices  that 
become  vehicles  for  research  and  training.  The 
people  who  staff  these  two  areas  form  a  diverse 
multidisciplinary  team  of  specialists  ranging 
from  psychologists,  research  instructor  pilots, 
and  human  factors  specialists  to  aerospace 
engineers,  mathematicians,  and  computer  tech¬ 
nologists.  With  this  uncommon  mix  of  exper¬ 
tise,  the  Division  converts  training  needs  Into 
the  knowledge  and  products  needed  to  improve 
the  combat  effectiveness  of  the  operational 
commands. 


Colonel  Carl  D.  Eliason 
Division  Chief 


Dr.  Hilton  E.  Wood 
Technical  Director 

TRAINING  EFFECTIVENESS  PLAN 


As  a  result  of  a  Simulator  Broad  Area  Review 
convened  at  Headquarters,  Air  Force  Systems 
Command  (AFSC)  in  February  1984,  AFHRL  was 
tasked  to  develop  an  aircrew  simulator  training 
effectiveness  R&D  plan.  This  training  effec¬ 
tiveness  plan  was  to  focus  on  efforts  which 
addressed  training  performance  measurement  and 
the  general  question  of  how  much  fidelity  is 
enough  with  regard  to  current  and  emerging 
aircrew  simulation  capabilities. 

In  May  1984,  the  AFHRL  training  effectiveness 
plan  consisting  of  eight  major  R&D  issues  was 
briefed  to  Headquarters,  AFSC,  and  was  favorably 
received.  Based  on  concerns  by  the  Aerospace 
Medical  Division  regarding  the  importance  of 
defining  and  optimizing  the  total  aircrew 
training  system,  top  priority  was  given  to  R&D 
which  explores  training  system  design.  R&D 
addressing  motion  and  force  issues  (Force 
Cueing  System  Fidelity)  was  given  last  priority 
and  was  supported  only  on  an  overceiling  basis 
because  of  the  extensive  research  already 
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completed  on  centerline-thrust  aircraft.  The 
Issues  and  priorities  are  as  follows: 

Priority  Issue 

1.  Training  System  Design 

2.  Visual  Scene  Fidelity 

3.  Sensor  Scene  Fidelity 

4.  Instructor  Operator  Station  Design 

5.  Aircrew  Performance  Measurement 

6.  Cost-Training  Effectiveness  Relationships 

7.  Simulator  Instructional  Strategies 

8.  Force  Cueing  System  Fidelity 

In  general,  the  training  effectiveness  plan 
asks  the  following  kinds  of  R&D  questions: 

1.  How  do  you  assemble  the  many  components 

of  a  total  training  system? 

2.  What  level  of  fidelity  Is  needed  for 

specific  training  situations? 

3.  How  should  Instructor  stations  be 

designed? 

4.  What  measures  can  be  used  to  quantify 

training  effectiveness? 

5.  What  cues  are  most  effective  for 

learning  specific  skills? 

Since  Implementation  of  the  training  effective¬ 
ness  plan,  the  Operations  Training  Division  has 
pursued  a  comprehensive  program  of  R&D.  Lab¬ 
oratory  direction  of  the  training  effectiveness 
plan,  has  been  formalized  through  a  Program 
Management  Directive  for  Training  Effectiveness 
R&D  and  Is  monitored  by  the  AFHRL  Plans  and 
Programs  Office. 

The  second,  third,  and  fourth  Issues  are  of 
special  Interest  to  the  Deputy  for  Simulators 
at  the  Air  Force  Aeronautical  Systems  Division, 
and  special  training  effectiveness  working 
groups  have  been  formed  to  assure  coordination 
and  approval  of  relevant  training  effectiveness 
R&D  between  that  Division  and  AFHRL.  A  memo¬ 
randum  of  agreement  between  these  organi¬ 
zations  has  formally  established  the  training 
effectiveness  working  groups  under  the 
cognizance  of  a  Training  Effectiveness  R&D 
Conference  that  meets  twice  a  year  to  share 
training  effectiveness  Information. 

Due  to  the  expanding  role  of  the  Deputy  for 
Simulators  Into  the  domain  of  manpower, 


personnel,  and  training  requirements,  the  for¬ 
mation  of  a  fourth  training  effectiveness 
working  group  In  support  of  Issue  1,  Training 
System  Design,  will  be  considered  during  the 
Training  Effectiveness  R&D  Conference  at  Eg  1 1 n 
AFB  In  early  FY86. 

The  training  effectiveness  plan  Is  generating  a 
significant  database  In  the  seven  R&D  areas 
comprising  the  plan.  Financial  support  of  the 
plan  ranges  across  all  program  elements  and 
projects  available  to  the  Operations  Training 
Division,  plus  occasional  funding  from  the  Air 
Force  Aeronautical  Systems  Division.  The  formal 
reporting  of  the  final  products  Is  accomplished 
through  AFHRL  technical  reports  and  technical 
papers. 


ELECTRONIC  COMBAT  TRAINING  EFFECTIVENESS 

Proficiency  In  electronic  combat  (EC)  Is  In¬ 
creasingly  recognized  as  essential  to  success 
In  modern  conflict.  For  the  aircrew  with  a 
primary  mission  of  alr-to-surface  or  air-to-air 
weapons  employment,  EC  proficiency  Involves  re¬ 
cognizing  and  responding  to  threat  situations, 
by  avoiding,  countering,  or  even  destroying 
threat  systems.  Also,  knowledge  and  employment 
of  weapon  system  capabilities  are  required  in 
order  to  take  advantage  of  threat  system  limi¬ 
tations. 

The  Air  Force  needs  a  systematic  overall  strat¬ 
egy  for  the  acquisition  of  training  systems  to 
support  EC  training.  EC-capable  ranges  for  In¬ 
flight  training  are  limited  In  number  due  to 
the  lack  of  sufficient  airspace  and  the  high 
cost  of  threat  simulators  and  range  Instrumen¬ 
tation  systems.  Flight  simulators  are  often 
deficient  due  to  cost  and  difficulties  In  main¬ 
taining  the  hardware  and  software  current  with 
the  aircraft  EC  systems.  Such  considerations 
have  led  the  Tactical  Air  Command  toward  systems 
such  as  the  On-Board  Electronic  Warfare  Simula¬ 
tor  (OBEWS)  for  Inflight  training  and  the  EC 
part-task  trainer  (EC  PTT)  for  ground  training. 
However,  data  are  required  for  determining  what 
contribution  the  various  systems  can  make  to 
training  (l.e.,  what  task  they  can  train  and  to 
what  level),  as  well  as  on  how  to  develop  an 
Integrated  training  program. 


Tectronic  Combat 


Aircrew  Surveys 


The  Operations  Training  Division  is  currently 
work  ing  on  the  development  of  an  integrated 
EC-training  program  for  the  F— 16  aircraft.  This 
program  can  serve  as  a  model  for  other  weapon 
systems  and  is  a  critical  element  in  the  Air 
Force  Roadmap  for  EC  Training.  Studies  have 
already  been  completed  on  feedback  requirements 
for  EC  range  systems,  retention  of  EC  skills, 
and  transfer  of  training  from  the  flight  simula¬ 
tor  to  a  range  exercise.  Future  studies  will 
address  the  EC-training  capabilities  of  the  EC 
PTT,  the  F-16  Operational  Flight  Trainer  (OFT), 
and  08EUS,  as  well  as  the  requirements  for  high 
resolution  visual  cueing  to  support  end-game 
training.  The  results  of  these  efforts  will  be 
used  in  the  development  and  evaluation  of  an 
integrated  EC-training  program. 

In  the  past  year,  the  Operations  Training  Divi¬ 
sion  has  assisted  Headquarters,  USAF  in  develop¬ 
ing  an  integrated  and  comprehensive  plan  (i.e., 
the  Roadmap  for  EC  Training)  and  in  identifying 
requirements  for  the  EC  PTT.  The  Division  has 
also  participated  In  the  Tactical  Air  Forces 
EC-Training  Study  Group  and  has  supported  the 
Air  Force  Armament  Division  in  the  design  of  a 
training  effectiveness  evaluation  for  the  OBEWS 
system.  Ongoing  programs  will  upgrade  the 
threat  modelling  capabilities  for  tactical 
training  RSD  (THREATVAL)  and  will  examine  the 
sensitivity  of  tactics  effectiveness  to  pilot 
performance  variations  (TACTRAIN). 

The  overall  goal  of  these  eiiorts  is  to  develop 
a  technical  database  on  EC  training,  specify  EC 
PTT  design  requirements,  and  provide  an  objec¬ 
tive  basis  for  a  systematic  investment  strategy 
for  EC-training  systems. 

PART-TASK  TRAINING 

The  Air  Force  needs  low-cost,  effective  a trcrew 
training  devices  that  will  improve  the  profi¬ 
ciency  and  readiness  of  aircrews.  The  search 
for  advanced,  low-cost  training  systems  implies 
decreasing  use  of  aircraft  and  expensive  simu¬ 
lators  and  increased  use  of  part-task  trainers 
for  many  of  the  basic  procedural,  perceptual, 
and  cognitive  aspects  of  aircrew  training. 


The  Operations  Training  Division  has  completed 
a  series  of  surveys  using  experienced  aircrews. 
The  purpose  was  to  identify  the  types  of  tasks 
and  levels  of  training  complexity  that  can  be 
most  appropriately  supported  by  high  technology, 
low-cost  training  media.  These  media  include 
microcomputer  graphics  systems  and  interactive 
videodiscs. 

Part-Task  Methods  RSD 

While  various  inexpensive  technologies  have  the 
potential  of  satisfying  part-task  training  re¬ 
quirements,  the  fundamental  issue  is  selection 
of  proper  training  methodology,  rather  than  de¬ 
vice  design.  A  project  now  underway  will  pro¬ 
vide  the  Air  Force  with  a  theoretical  and  em¬ 
pirical  foundation  on  which  to  base  part-task 
trainer  design. 

Thus  far,  a  comprehensive  review  of  theoretical 
and  empirical  research  in  part-task  training  has 
been  completed.  This  effort  has  produced  a 
foundational  database  for  extending  methods  RSD. 
In  addition  to  the  literature  review,  a  second 
product  is  an  automated  decision  support  system 
that  recommends  part-task  training  solutions  for 
specific  types  of  tasks.  Current  RSD  is  focused 
on  task  analysis  and  cognitive  and  mathematical 
modeling  of  selected  types  of  tasks.  These  ef¬ 
forts  will  extend  the  database  and  expand  the 
power  and  flexibility  of  the  decision  support 
system. 

Technology  Transfer 

One  of  the  goals  of  part-task  training  RSD  is 
the  rapid  transfer  of  technology  to  the  field. 
Two  experimental  products  have  been  developed 
and  validated:  an  EC  part-task  trainer  for  the 
Tactical  Air  Command  (TAC)  and  a  Fuel  Savings 
Advisory  System  (FSAS)  part-task  trainer  for  the 
Military  Airlift  Command  (MAC). 

The  EC  trainer  simulates  common  Radar  Warning 
Receiver  (RWR)  equipment  and  electronic  counter¬ 
measures  ( ECM )  systems  used  in  many  tactical 
aircraft.  Training  tasks  include  equipment 
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operation,  malfunction  analysis,  symbology 
interpretation,  and  optimum  ECM  responses.  The 
training  effectiveness  of  this  device  has  been 
established  empirically  in  extensive  field  test¬ 
ing.  Results  show  that  the  performance  of  stu¬ 
dents  trained  on  the  RWR  part-task  trainer  is 
consistently  superior  to  that  of  students  train¬ 
ed  via  conventional  (classroom)  methods.  As  a 
result  of  this  RSD,  TAC  is  in  the  process  of 
procuring  RWR  trainers  for  their  operational 
training  units.  This  R&O  product  has  been  rec¬ 
ognized  by  TAC  as  a  valid  means  of  enhancing 
the  combat  readiness  and  survivability  of  its 
a  ircrews. 

The  FSAS  part-task  trainer  was  developed  as  a 
cost-effective  alternative  to  training  in  the 
actual  aircraft.  The  basic  operations  of  the 
FSAS  are  simulated  by  a  microcomputer-based 
graphics  systems,  and  the  student  simulates  op¬ 
erating  the  system  via  a  touch  screen.  Device 
training  effectiveness  was  assessed  by  training 
two  groups  of  C-141  pilots  to  use  the  FSAS;  one 
group  was  trained  via  the  microcomputer,  and  the 
other  was  trained  in  the  actual  aircraft.  All 
students  were  trained  to  the  same  proficiency 
level,  and  the  training  times  were  recorded  for 
each  student.  The  experiment  demonstrated  con¬ 
clusively  that  the  low-cost  trainer  was  fully 
as  effective  as  the  aircraft  for  training  pilots 
in  basic  FSAS  operations.  Empirical  results 
were  applied  to  cost  data  to  derive  a  cost  ben¬ 
efit  ratio  of  173  to  1  (aircraft  training  cost 
vs.  microcomputer  training  cost).  This  repre¬ 
sents  a  cost  avoidance  of  more  than  10  million 
dollars  as  applied  to  training  of  current  C-141 
and  C-5  aircrews  in  FSAS  basic  operations. 

These  part-task  training  demonstrations  under¬ 
score  the  power  of  this  level  of  technology  to 
improve  aircrew  proficiency  and  readiness  while 
reducing  training  costs. 

COMBAT  MISSION  TRAINER 

Today's  tactical  force  faces  a  tremendous 
threat  in  the  role  of  ground  target  attack. 
The  hostile  environment  includes  several  types 
of  surface-to-air  missiles,  radar/computer- 
directed  antiaircraft  guns,  and  communications 
jamming  equipment,  as  well  as  enemy  fighters. 
To  complicate  things  further,  the  enemy  ground 


threats  are  mobile  and  can  be  moved  quickly. 
Also,  the  enemy  movements  that  must  be 
interdicted  tend  to  be  made  under  cover  of 
night  or  in  bad  weather  to  frustrate  the 
aircraft  offenses  by  forcing  them  to  rely  on 
night  or  bad  weather  sensors  to  navigate  and 
locate  targets. 

The  solution  to  these  problems  is  to  fly  multi¬ 
aircraft  formations  at  high  speed  and  very  low 
altitudes;  e.g.,  following  the  bottoms  of  val¬ 
leys  or  other  low  places  to  avoid  detection  by 
enemy  radar.  These  aircraft  would  have  in¬ 
frared  and  radar  sensors  to  supplement  or  re¬ 
place  visual  out-the-cockpit  imagery  and  also 
would  carry  sophisticated  electronic  warfare 
equipment  to  jam  enemy  missiles,  anti-aircraft 
guns,  and  communications.  However,  training 
the  pilots  to  fly  such  complex,  coordinated 
multiship,  multisensor  missions  is  very 
difficult.  The  ideal  situation  would  be  to 
practice  against  the  enemy  threats  over  enemy 
terrain  with  the  aircraft  teams  flying  together. 
Reconnaissance  can  determine  exactly  what  the 
enemy  terrain  is  like  and  where  their  threats 
are  currently  located.  Thus,  if  there  was  a 
multiship,  multisensor  simulator  that  would 
provide  practice  over  simulated  enemy  terrain, 
pilots  could  train  for  these  complex  missions 
in  a  realistic  environment  before  having  to  ac¬ 
tually  fly  them.  They  could  develop  and  per¬ 
fect  their  coordinated  tactics  and  skills 
against  the  expected  threat  environment.  For 
such  operational  simulators  to  be  usable  for 
tactical  front-line  forces,  they  would  need  to 
be  sufficiently  transportable  and  low  cost  so 
that  a  reasonable  number  could  be  located  at 
front  line  bases  or  at  least  at  regional  train¬ 
ing  centers. 

Developing  such  a  simulator  is  the  major  chal¬ 
lenge  facing  the  Operations  Training  Division 
during  the  1980's.  Previous  simulators  have 
been  single-ship,  with  emphasis  on  simplified 
visual  out-of-the-cockpit  scenes.  Threats  were 
modelled  in  a  simplified  manner.  Only  recently 
have  nighttime  (infrared)  and  all-weather 
(radar)  imagery  been  included,  and  then  just  for 
a  single-ship.  Such  imagery  has  not  been  cor¬ 
related  with  visual  scenes.  Furthermore,  the 
simulators  have  been  very  large,  non-transpor¬ 
table,  and  expensive.  Obviously,  there  is 
still  a  long  way  to  go  to  achieve  the  needed 
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combat-mission  training  capability,  but  progress 
is  being  made  from  two  directions.  The  first 
is  a  full-capability,  but  expensive  and  non¬ 
transportable,  "brassboard"  system  that  will 
allow  investigation  into  just  what  is  and  is 
not  Important  In  simulating  a  "full-up"  multi¬ 
ship  mission  under  modern  combat  conditions. 
The  other  is  a  limited-capability,  low-cost, 
transportable  two-ship  simulator  using  a  small- 
sized,  helmet-mounted  visual  display  system  that 
projects  the  scene  directly  into  the  pilot's 
helmet.  This  Fiber-Optic  Helmet-Mounted 
Display  (FOHMD)  effort,  being  conducted  jointly 
with  the  Canadian  Government,  will  result  in  a 
helmet-display,  head-  and  eye-tracked,  two-ship 
system. 

The  FOHMD  project  avoids  the  high  cost  and 
transportability  problems  inherent  with  large 
visual  display  domes.  This  system  projects  the 
visual  scene  from  "light  valves"  via  fiber-optic 
bundles  through  lenses  mounted  on  a  helmet,  then 
directly  into  the  pilot's  eyes.  As  the  pilot's 
head  is  moved,  the  visual  scene  being  projected 
into  the  pilot's  eyes  has  to  move  corresponding¬ 
ly.  Also,  as  the  pilot's  eyes  are  rotated  with 
respect  to  the  head,  a  high-resolution  inset  in 
the  visual  scene  needs  to  be  moved  with  respect 
to  the  rest  of  the  scene.  This  means  that  the 
simulator  must  know  the  position  of  the  pilot's 
head  and  also  the  pilot's  eyes.  This  is  re¬ 
ferred  to  as  "head-  and  eye-tracking,"  and 
doing  it  properly  Is  a  key  R&D  issue.  Future 
R&D  on  this  device  will  be  concentrated  on 
refining  the  helmet  display  system  and  on 
investigating  two-ship  training  using  low-cost 
visual  scene  generation  and  distributed 
microcomputer-based  computations  of  the  flight 
equations.  When  the  system  is  fully  de¬ 
veloped,  it  could  lead  to  the  final  development 
by  the  Simulator  SPO  of  an  early  two-ship  tac¬ 
tical  simulator  capability  that  would  be  trans¬ 
portable  and  low  in  cost. 

In  parallel  with  the  FOHMD,  a  "full  up"  multi- 
ship,  multisensor,  brassboard  combat  mission 


trainer  (CMT)  simulator  is  being  assembled  for 
R&D  purposes.  It  will  incorporate  and  apply 
most  of  the  advanced  R&D  projects  at  the  Opera¬ 
tions  Training  Division,  It  will  utilize  the 
Advanced  Visual  Training  System  (AVTS),  which 
has  the  high  resolution  and  scene  detail  needed 
for  air-to-ground  combat  at  high  speed  and  low 
altitudes.  It  will  utilize  highly  detailed 
threat  models  (missiles  and  antiaircraft  guns), 
detailed  such  that  pilots  can  try  to  detect  and 
avoid  the  threat.  The  most  advanced  multi- 
sensor  infrared  and  radar  imagery  will  be  used 
in  the  multimode  cockpit  displays.  In  addition 
to  the  FOHMD,  the  CMT  will  use  new  dome  tech¬ 
nologies  that  allow  smaller  domes  or  full 

f ield-of-view  projection.  Tying  this  all  to¬ 
gether  will  be  the  new  R&D  Instructor  Operator 
Station  (IOS)  that  can  handle  multiple  aircraft 
and  sensors  and  a  large  number  of  enemy  threats. 
In  this  advanced  IOS,  artificial  intelligence 
features  will  handle  threats  (to  make  them 

"smart")  and  other  station  features  such  as 
communications  with  the  pilots  via  speech  syn¬ 
thesis  and  speech  recognition.  The  IOS  will 
also  allow  measurement  of  mission  performance 
on  a  number  of  parameters. 

The  objective  of  the  brassboard  CMT  will  be  to 
determine  what  features  of  full-up  combat  need 
to  be  simulated  and  in  what  amount  of  detail; 
i.e.,  what  is  Important  and  what  is  not.  This 
training  effectiveness  evaluation  will  be  done 
not  only  through  experiments  planned  and  con¬ 
ducted  by  research  psychologists  but  also  by  the 
practical  judgment  of  experienced  pilots.  The 
final  development  agency  (Simulator  SPO)  needs 
to  know  what  features  are  Important  and  In  what 
detail,  and  this  vital  information  will  be 
determined  by  the  training  effectiveness  scien¬ 
tists  using  the  brassboard  full-up  simulator. 
The  low-cost,  transportable  multiship  simulator 
that  is  needed  to  train  and  rehearse  combat 
missions  will  then  be  made  available  In 
sufficient  quantities  for  front  line  pilots. 


Further  Information  on  any  of  these  projects  is  available 
from  the  points  of  contact  listed  on  page  80. 
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LOGISTICS  AND  HUMAN  FACTORS  DIVISION 


The  Logistics  and  Human  Factors  Division  of 
AFHRL  was  organized  in  1980  to  focus  computer 
science,  human  factors,  operations  research,  and 
engineering  skills  in  an  interdisciplinary  sys¬ 
tems  approach  to  research  and  development  of  new 
logistics  and  command/control  capabilities.  The 
Air  Force  2000  Study  and  the  Air  Force  Logistics 
Long  Range  Planning  Guide  state  the  need  for 
more  flexible,  mobile,  dispersed  operation  of 
tactical  air  forces.  The  Secretary  of  the  Air 
Force  has  directed  a  concerted  effort  to  exploit 
technical  data  automation  in  industry  and  gov¬ 
ernment.  The  Air  Force  is  also  pushing  forward 
with  an  expanded  military  role  in  space.  The 
Logistics  and  Human  Factors  Division  is  in  the 
forefront  with  key  technology  programs  that  will 
help  achieve  these  aims. 


Colonel  Donald  C.  Tetmeyer 
Division  Chief 


Bertram  W.  Cream 

Acting  Division  Chief  (29  Jul  to  30  Sep  85) 


MAINTENANCE  IN  COMBAT 


More  dispersed  and  mobile  tactical  aircraft 
operations  will  require  technicians  who  are 
generalists  rather  than  the  present  highly 
specialized  force.  Otherwise,  the  increased 
manpower  costs  for  each  aircraft  would  be  pro¬ 
hibitive.  However,  new  aircraft  will  be  even 
more  complex  and  technically  sophisticated  in 
order  to  maintain  a  combat  edge. 


Integrated  Maintenance  Information  System 

If  technicians  are  to  operate  effectively  as 
generalists,  they  will  need  much  better  diagnos¬ 
tics  and  maintenance  aids.  Such  aids  will  be 
tailored  to  technicians'  needs  for  each  job. 
They  will  provide  thorough,  easily  understood, 
step-by-step  instructions  for  unfamiliar  jobs, 
or  quick  prompts  and  checklists  for  well  known 
tasks.  The  technician's  window  on  this  informa¬ 
tion  will  be  a  small,  lightweight,  rugged, 
easily  carried  stand-alone  computer  and  data 
display  for  flight-line  use.  It  can  be  plugged 
into  an  aircraft  data  bus  for  interactive  trou¬ 
bleshooting  and  will  allow  dialogue  with  expert 
systems  aids.  It  will  have  a  radio  link  to 


maintenance  control  and  any  available  central 
database.  The  technician  can  plug  in  data 
cartridges  that  provide  battle  damage  assessment 
assistance  as  well  as  normal  technical  orders 
and  diagnostic  aids.  These  capabilities  are 
being  developed  in  a  multi-phased  program  called 
Integrated  Maintenance  Information  System 
(IMIS). 

The  first  phase  was  the  iterative  development 
and  tests  of  methods  for  displaying  technical 
data  on  a  screen  so  that  it  is  most  useful  to 
the  technician.  This  involved  a  break  with  the 
traditional  page  structure  of  technical  orders 
in  familiar  book  form.  Information  access  is 
most  flexible  and  responsive  when  the  data  are 
structured  as  elements  in  a  computer  database 
and  when  each  screen  image  is  constructed  as 
needed  from  the  basic  graphics  and  procedures. 
With  this  system,  the  technician  can  easily  move 
through  the  job  with  the  desired  level  of  detail 
instantly  calling  up  information  on  parts,  ex¬ 
planation  of  theory,  schematic  tracing,  or  test 
equipment  hookup,  yet  maintaining  overall  per¬ 
spective  and  task  sequence.  Diagnostics  assists 


are  graphic  and  dynamic.  The  display  system  was 
tested  at  Grissom  AFB  in  1985,  and  specifica¬ 
tions  were  produced  for  data  development  and 
electronic  coding. 

In  the  second  phase,  authoring  software  to  pro¬ 
duce  data  economically  in  this  electronic  form 
will  be  developed  and  tested  by  the  end  of  1986. 
An  experimental  model  of  the  portable  flight¬ 
line  display  computer  is  currently  under  con¬ 
tract  and  will  be  field  tested  in  1987-88. 
Tests  at  an  F-16  site  will  include  diagnostic 
interaction  with  the  aircraft  data  bus. 

The  final  phase  of  IMIS  will  be  a  complete 
development  of  the  interactive  diagnostics  to 
include  expert  system  aids  and  communication 
links  with  supply,  maintenance  control,  and 
historical  databases.  When  IMIS  is  implemented 
on  the  Advanced  Tactical  Fighter,  the  data  will 
be  updated  electronically  to  the  field  through 
data  management  and  communication  links  provided 
as  Phase  IV  of  the  Air  Force  Technical  Order 
System. 
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Maintenance  in  Combat  Environments 


The  Logistics  and  Human  Factors  Division  is  also 
conducting  several  projects  aimed  at  assessing 
and  improving  maintenance  capability  under 
severe  wartime  conditions.  A  set  of  computer 
simulation  models  and  data  collection  techniques 
was  developed  for  F-16  units  in  Europe  and  is 
now  being  validated  at  F-lll  aircraft  sites. 
In  1986,  field  research  will  be  conducted  under 
controlled  conditions  to  quantify  and  understand 
the  limitations  that  chemical  warfare  imposes 
on  the  ability  to  do  a  representative  range  of 
maintenance  tasks.  Another  project.  Small  Unit 
Maintenance  Manpower  Analysis,  is  developing 
structured  methods  for  establishing  the  set  of 
tasks  that  a  single  technician  should  perform; 
this  will  be  used  to  define  job  duties  and 
training  of  the  new  maintenance  generalists. 


PROVIDING  LOGISTICS  RESOURCES 

The  conditions  of  wartime  flying  impose  differ¬ 
ent  stress  and  demands  on  the  weapon  systems  and 


the  supporting  logistics  systems  than  are  exper¬ 
ienced  in  peacetime.  Weapons  delivery  and 
electronic  countermeasures  are  the  most  obvious 
examples.  Deployment  to  a  different  theater  and 
climate  can  also  result  in  substantial  changes 
from  the  previous  patterns  of  demand.  In  order 
to  adequately  plan  for  wartime  support,  the  Air 
Force  needs  databases  and  analysis  methods  that 
are  sensitive  to  wartime  variables.  The  Logis¬ 
tics  and  Human  Factors  Division  is  assembling 
an  extensive  database  of  worldwide  combat  main¬ 
tenance  experience  and  is  developing  analytical 
techniques  that  can  be  used  to  combine  this 
information  with  other  weapon  system  reliability 
measures  to  improve  predictive  capability.  One 
aspect  of  this  work  is  the  joint  development 
(with  the  Air  Force  Flight  Dynamics  Laboratory) 
of  methods  to  plan  the  resources  essential  for 
Aircraft  Battle  Damage  Repair.  A  new  project 
starting  in  FY86  will  explore  the  application 
of  expert  systems  and  Information  systems  anal¬ 
ysis  to  improve  the  efficiency  and  responsive¬ 
ness  of  spare  parts  acquisition  to  meet  these 
combat  resource  needs. 


/  -- 
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IMPROVING  RELIABILITY  AND  MAINTAINABILITY 

Several  projects  are  in  process  that  will  enable 
more  reliable  and  maintainable  weapon  systems 
to  be  fielded  in  a  shorter  time  and  at  lower 
costs.  The  Unified  Data  Base  for  Acquisition 
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logistics  is  developing  and  testing  an  interac¬ 
tive  automated  database,  for  logistics  support 
analysis,  that  will  be  interfaced  with  computer- 
aided  design.  This  system  will  have  application 
on  the  F-15E  aircraft  program,  as  well  as  on 
space  and  missile  programs.  The  Mission  Re  1 4— 
ability  Model  is  an  automated  technique  for 
optimizing  the  design  of  new  se If -reprogramm ing 
architectures  that  are  impossible  to  analyze 
with  traditional  reliability  models.  The  Mis¬ 
sion  Reliability  Model  shows  the  designer  how 
to  maximize  mission  success  with  the  minimum 
redundancy.  It  has  been  tested  and  used  in 
design  of  the  Integrated  Communication  Naviga¬ 
tion  Information  Avionics  and  has  wide  applic¬ 
ability  to  many  new  aircraft  and  space  systems 
des  igns . 

Maintenance  and  Logistics  in  Computer-Aided 
Des  ign 

A  key  technology  that  promises  enormous  leverage 
for  AFHRL  investment  is  the  development  of 
computer-aided  design  software  for  logistics 
analysis.  The  defense  industry  is  going  to 
computer-a ided  design  for  hardware  design  and 
engineering  analysis.  Recent  developments  in 
computer  storage,  computer  graphics,  and  com¬ 
puter  networks  now  make  it  possible  to  perform 
maintenance  and  reliability  analysis  iteratively 
with  design,  almost  at  the  point  of  design 
inception.  A  design  team  can  include  reliabil¬ 
ity  and  maintainability  engineers  with  networked 
computer  work  stations.  A  recent  demonstration 
of  redesign  of  the  Ground  Launched  Cruise 
Missile  produced  10-fold  improvements  using  a 
computer  display  of  a  technician's  tools,  arm, 
and  hand  in  graphic  analysis  of  accessibility. 
Also  graphic  thermal  mapping  was  used  to  show 
where  relocation  of  components  could  signifi¬ 
cantly  reduce  heat  stress  failures.  A  second 
demonstration  is  underway  in  the  design  of  the 
F-15E  aircraft.  A  graphic  model  will  be  used 
in  designing  the  capability  for  munitions  load¬ 
ing  and  servicing  within  the  tight  space  con¬ 
straints  of  a  hardened  aircraft  shelter.  Longer 
term  projects  include  the  development  of  even 
more  accurate,  anthropometr ic ,  fully  mobile 
human  models  for  use  In  such  graphic  analyses, 
as  well  as  other  automated  reliability  and 
testability  analysis  routines. 


integrated  Design  Support 


A  joint  project  is  underway  with  the  Flight 
Dynamics  Laboratory  to  develop  the  architecture, 
data  interface  standards,  and  control  software 
for  fully  integrated  design,  logistics,  and 
manufacturing  data  systems.  The  architecture 
development  and  Phase  I  demonstration  will  be 
completed  in  1986.  This  work  is  being  performed 
by  a  consortium  headed  by  Rockwell  Corporation 
and  is  using  the  B-1B  aircraft  structural  design 
as  the  test  application.  An  industry  technical 
assessment  group  meets  quarterly  to  review  the 


progress  and  assure  widespread  applicability  and 
generality  of  the  results. 


COMMAND/CONTROL  TEAM  PERFORMANCE 

The  Logistics  and  Human  Factors  Division  is 
working  with  the  Tactical  Air  Warfare  Center, 
U.S.  Air  Forces  in  Europe,  Rome  Air  Development 
Center,  Tactical  Air  Command,  Tactical  Air  Force 
Interoperability  Group,  Electronic  Systems 
Division,  and  Armstrong  Aerospace  Medical 
Research  Laboratory  to  improve  training  and 
performance  of  tactical  command  and  control 
teams.  A  model  training  program  was  developed 
and  used  to  smooth  the  introduction  of  the 
German  EIFEL  system  into  the  U.S.  NATO  forces. 
Detailed  system  information  architecture  and 
automated  task  analyses  databases  have  been 
developed  for  the  Blue  Flag  Exercises  and  for 
certain  logistics  control  functions  in  Europe. 
Such  analyses  form  the  basis  for  process  review, 
simulation  of  alternative  procedures,  and 
training.  Techniques  for  developing  credible 
system  arch itectures  and  task  analyses  of 
wartime  functions  that  cannot  be  directly 
observed  is  one  of  the  major  technological  goals 
of  this  work. 

The  in-house  tactical  team  performance  and 
decision  tra  in  ing/s imulat ion  research  facility 
has  been  upgraded  with  advanced  software.  This 
facility  will  now  be  of  greater  use  in  studying 
the  decision-making  process  of  air  tasking  order 
development.  This  software  is  also  transporta¬ 


ble  for  data  collection  in  field  exercise  envi¬ 
ronments.  A  new  facility  and  expanded  computer 
capability  to  be  completed  in  FY86  will  signif¬ 
icantly  enhance  the  research  program  in  human 
information  processing  and  decision  making  in 
functionally  distributed,  physically  dispersed 
tactical  command  and  control  systems.  This 
research  provides  the  theoretical  and  conceptual 
foundation  for  development  and  test  of  improved 
decision  making/training  methods.  The  Labora¬ 
tory  is  also  planning  a  direct  data  link  to  the 
Battle  Management  Simulation  Facility  at  Rome 
Air  Development  Center  where  new  operational 
hardware  and  automated  decision-aiding  systems 
are  developed. 

Other  work  getting  underway  in  FY85  included 
research  on  the  potential  of  photogrammetry- 
based,  computer-image-generated,  dynamic  visual 
simulations  for  training  mission  planning  and 
other  command  and  control  functions.  The  Air 
Force  Electronic  Systems  Division's  Combat 
Identification  System/Information  Subsystem  is 
being  used  as  an  initial  testbed  for  AFHRL 
research  on  modeling  the  impact  of  automation 
of  command  and  control  processes.  The  aim  is 
to  develop  data  and  modeling  techniques  that  can 
be  used  by  the  Air  Force  Electronic  Systems 
Division  and  Rome  Air  Development  Center  during 
design  to  simulate  the  effect  of  specific  auto¬ 
mation  alternatives  on  overall  function  and 
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system  performance.  Also  in  FY85,  a  preliminary  grated  Maintenance  Information  System  and  Inte- 
study  was  completed  on  training  for  wartime  grated  Design  Support,  directly  supports  this 
logistics  command  and  control  functions  in  initiative.  The  Logistics  and  Human  Factors 
Europe.  The  next  step  is  development  of  a  pro-  Division  is  installing  an  integrated  and  fully 
totype  program  to  train  American  logistics  con-  networked  in-house  computer  capability  to  enable 
trollers  on  the  NATO  procedures  that  would  be  the  development  and  test  of  new  specifications 
followed  in  the  event  of  a  European  war.  Cut-  and  standards  and  of  software  for  interchange 
ting  across  all  these  efforts  is  the  development  of  text  and  graphics  between  dissimilar  com- 
of  an  automated  and  user-friendly  database  for  puter  systems.  In  addition,  plans  are  underway 
command  and  control  task  and  architecture  data  for  accelerated  research  on  a  more  economical 
that  can  be  used  as  the  basis  for  training  pro-  automated  and  user-friendly  database  management 
gram  development  and  performance  simulation.  approach  to  handle  system  architectural  and  task 

analysis  data.  This  "Meta  Model"  of  the  data 
AUTOMATED  TECHNICAL  INFORMATION  will  cut  across  every  major  project  in  the 

Division  program.  It  attacks  what  appears  to 
AFHRL  has  responsibility  for  the  research  and  be  the  biggest  technical  roadblock  to  the 
development  needed  to  achieve  the  goals  of  the  exploitation  and  expansion  of  integrated  infor- 
Automated  Technical  Information  initiative.  mation  processing  throughout  industry  and  the 
Much  of  the  ongoing  work,  such  as  the  Inte-  DOD. 


Maintenance  Technician  Prepares  his  Charge  for  the  Coming  Day’s  Flight 


Further  information  on  any  of  these  projects  Is  available 
from  the  points  of  contact  listed  on  page  81. 
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TRAINING  SYSTEMS  DIVISION 
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instructional  and  learning  strategies,  defini¬ 
tion  of  training  and  performance  requirements, 
performance  assessment  and  evaluation,  training 
quality  control,  cognitive  and  motivational 
aspects  of  instruction,  and  artificial  intelli¬ 
gence  applications  to  instructional  delivery  and 
support.  The  Training  Management  and  Delivery 
Subthrust  addresses  RAD  on  development  and  man¬ 
agement  of  instruction  for  both  classroom  and 
on-the-job  training.  Included  are  efforts  per¬ 
taining  to  the  use  of  computer-aided/managed 
instruction  and  maintenance  simulation.  Over¬ 
all,  the  Training  Systems  Division  has  an 
applied  research  focus,  with  exploratory  devel¬ 
opment  work  occurring  in  both  Division  sub¬ 
thrusts.  The  basic  research  activities  of  the 
Division  are  oriented  mainly  toward  skills 
acquisition  and  intelligent  systems,  while 
advanced  development  work  is  mainly  in  the  area 
of  on-the-job  training. 


Colonel  Gene  A.  Berry 
Division  Chief 


The  Training  Systems  Division  is  in  the  process 
of  moving  from  Lowry  AFB,  Colorado,  to  Brooks 
AFB,  Texas,  and  is  presently  located  at  the  two 
bases.  The  primary  objective  of  the  Division 
is  to  develop  improved  individual  and  unit 
training  methods  and  strategies  for  skills 
development,  leading  to  effective  job  perfor¬ 
mance.  Specific  technical  programs  include 
development  and  demonstration  of  Improved 
training  methods,  instructional  and  learning 
strategies,  and  training  design  and  evaluation 
technologies.  Other  projects  include  (a)  devel¬ 
opment  of  tools  for  computer-based  training, 

(b)  simulation  of  maintenance  activities,  and 

(c)  application  of  artificial  intel 1 igence 
technology  to  training  and  enhanced  job  perfor- 
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Dr.  Joseph  Yasutake 
Technical  Advisor 


The  Division's  Training  Design  and  Delivery 
Thrust  is  structured  to  develop,  Integrate,  and 
demonstrate  Improved  training  systems  and  tech¬ 
nologies  for  Initial  skill,  on-the-job,  and  unit 
training  programs.  The  thrust  objective  is 
addressed  through  work  in  two  subthrusts:  Skills 
and  Performance  Specification  Systems  and  Train¬ 
ing  Management  and  Delivery  Systems. 

The  Skills  and  Performance  Subthrust  addresses 
RSD  on  the  content  and  process  of  instruction, 


TRAINING  DESIGN  AND  DELIVERY  RAD 

As  the  twenty-first  century  approaches,  training 
in  the  Air  Force  will  continue  to  be  a  critical 
and  resource-intensive  component  for  achieving 
mission  success.  However,  training  will  likely 
move  from  the  traditional  methods  of  classroom 
instruction  and  journeyman-apprentice  job  struc¬ 
tures  to  more  position  and  job-site  oriented 
training.  This  change  is  needed  because  in¬ 
creasingly  complex  weapon  systems  and  supporting 


maintenance  equipment  are  being  deployed.  Such 
complexity  will  create  challenges  in  developing 
and  using  training  technologies  that  will  sup¬ 
port  the  technicians  in  accomplishing  their 
jobs.  The  Training  Systems  Division  will  meet 
these  challenges  by  developing  rigorous  R&D 
procedures  and  by  refining  technologies  that 
will  accomplish  the  following  tasks: 

1.  Develop  affordable,  maintainable, 
state-of-the-art  computer-based  instructional 
systems  to  effectively  address  present  and 
future  training  needs. 

2.  Develop  and  apply  artificial  intelli¬ 
gence  technology  to  training  and  job-aiding, 
thereby  enhancing  the  job-readiness  of  the  tech¬ 
nicians. 

3.  Develop  and  demonstrate  a  prototype 
system  to  manage,  administer,  and  evaluate  the 
on-the-job  training  program;  to  ameliorate  its 
present  labor/paper  intensiveness  and  its  com¬ 
petition  with  mission  requirements;  and  to 
enhance  surge-accommodat i  i  capability. 

4.  Enable  the  Air  Force  to  establish  the 
requirements  for  and  to  evaluate  the  efficacy 
of  potential  and  operational  technology  appli¬ 
cations  through  better  techniques  for  training 
design  and  performance  evaluation. 

COMPUTER-BASED  INSTRUCTION 

The  development,  delivery,  and  evaluation  of 
instruction  using  computer  support  has  made 
increasingly  larger  inroads  in  the  civilian 
sector.  Compared  to  traditional  instruction, 
computer-based  Instruction  clearly  has  superior 
capability  for  variable  learning  speeds  and 
adaptability  to  the  state  of  the  learner. 
However,  adoption  of  this  technology  within  the 
military  has  been  less  regular  and  has  often 
met  problems  of  institutional  change.  Another 
major  obstacle  to  a  more  widespread  adoption  of 
this  technology  is  the  lack  of  flexible  yet 
standardized  general  purpose  instructional 
development/management  computer  software. 

Instructional  Support  Software  System 

In  the  1970's,  AFHRL  developed  a  large-scale 
computer-based  instructional  system  employing 


both  computer-aided  and  computer-managed  in¬ 
struction.  This  system  was  designed  to  develop 
and  manage  the  training  for  a  large  number  of 
students  in  several  training  courses,  using  a 
large  mainframe  computer  that  would  also  support 
R&D  on  related  training  issues.  The  successful 
demonstration  of  this  system  led  to  the  Instruc¬ 
tional  Support  Software  System  ( I S S  ' ,  which  is 
based  on  the  design  principles  of  modular  con¬ 
struction,  machine  independence,  and  utilization 
of  a  higher-order  language  (Ada).  The  end 
result  is  a  Government-owned  software  package, 
for  computer-based  instruction,  that  is  machine 
and  operating  system  Independent,  and  that  is 
easily  modifiable  to  permit  incorporation  of 
future  hardware  and  software  advances.  The  ISS 
can  be  used  to  address  a  training  requirement 
without  being  dependent  on  a  particular  vendor- 
supplied  hardware/software  package.  Also,  the 
users  can  tailor  the  system,  through  modular 
design,  to  their  unique  needs  rather  than  having 
to  restrict  or  modify  their  requirements  to  fit 
the  system. 

The  ISS  has  successfully  undergone  acceptance 
testing  by  the  development  contractor  and  is 
currently  undergoing  final  development/enhance¬ 
ment  efforts  for  computer-managed  Instruction. 
The  system  is  being  further  tested  in  several 
operational  contexts  by  various  Air  Force 
organizations: 

1.  The  Strategic  Air  Command  (SAC)  at 
Beale  AFB,  California,  is  using  ISS  on  a 
Pacific  Micro  PM200  to  develop  aircrew  training. 

2.  Also,  SAC  at  Dyess  AFB,  Texas,  is  using 
ISS  on  a  VAX  11/780  to  develop  aircrew  training 
for  the  B-1B  bomber. 

3.  The  Air  Training  Command  (ATC)  at  Lowry 
AFB,  Colorado,  is  using  ISS  to  develop  an 
Electronics  Principles  course. 

Other  Air  Force  units  are  also  preparing  to 
use  the  system  in  their  training  programs. 

ARTIFICIAL  INTELLIGENCE 

Artificial  Intelligence  (AI)  is  the  study  of 
intelligent  behavior  and  its  application  to  the 
development  of  machines  that  perform  tasks  or 
that  aid  in  the  performance  of  tasks  normally 
requiring  human  intelligence.  Traditional  areas 


of  R&D  In  the  field  have  been  automatic  methods 
for  solving  problems,  "understanding"  and  trans¬ 
lating  languages,  proving  theorems,  and  recog¬ 
nizing  speech.  These  topics,  when  placed  In  a 
training  and  job  performance  context,  appear 
obvious  candidates  for  augmenting  the  ability 
of  technicians  to  do  their  Jobs  and  to  facili¬ 
tate  the  Initial  skill  acquisition  required  of 
an  apprentice.  The  Air  Force  has  recognized 
that  AI  technology  Is  among  the  most  Important 
for  addressing  anticipated  and  current  needs 
related  to  dormant  and  dispersed  systems,  train¬ 
ing  the  generalist  and  "one-deep"  technician, 
and  troubleshooting  complex  systems.  Future 
progress  In  this  field  will  depend  on  the  devel¬ 
opment  and  demonstration  of  both  practical  and 
theoretical  knowledge. 

Knowledge  Acquisition/Intelligent  Authoring  Aids 

The  design  of  training  and  the  subsequent  eval¬ 
uation  of  the  outcomes  of  such  training  repre¬ 
sent  a  potentially  high-impact  focus  for  appli¬ 
cation  of  artificial  Intelligence  technology. 
A  Joint-Services  R&D  Initiative  addresses  the 


development  of  Intelligent  computer-assisted 
instruction  ( ICAI >  tools.  The  major  goals  of 
the  effort  are  to  design  snd  Implement  a  student 
diagnostic  model  for  ICAI  and  to  build  a  knowl¬ 
edge  acquisition  system  and  associated  authoring 
aids  for  the  student  model,  as  well  as  an  in¬ 
structional  model.  Follow-on  R&D  will  test 
these  tools  In  specific  military  applications. 

Speech  Recognition 

The  development  of  reliable  speech  recognition 
systems  for  training  and  job  aiding  has  the 
potential  for  significantly  facilitating  the 
Interaction  of  the  student  or  technician  with 
technical  material.  A  developmental  contract 
project  has  been  Initiated  to  extend  and  evalu¬ 
ate  a  new  methodology  for  machine  recognition 
of  speech.  Rather  than  utilizing  the  tradi¬ 
tional  statistical  approaches,  this  methodology 
will  utilize  word  Identification  processes.  The 
goal  Is  to  achieve  more  accurate  recognition 
plus  the  ability  to  dynamically  add  new  words 
to  the  machine  vocabulary. 
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AIR  FORCE  ON-THE-JOB  TRAINING 


Knowledge  Engineering 

An  expert  system  or  artificial  Intelligence 
system  with  Inadequate  or  sparse  knowledge  Is 
clearly  a  contradiction  In  terms.  Thus,  the 
most  critical  and  time-consuming  process  In  the 
development  of  expert  systems  Is  the  construc¬ 
tion  of  the  knowledge  base  for  the  domain  under 
study.  This  Is  called  knowledge  engineering; 
i.e.,  building  enough  knowledge  of  facts  and 
relations  among  these  facts  to  be  qualified  as 
an  expert.  An  RSD  project  will  design  a  method¬ 
ology  for  multiple  knowledge  representation  to 
address  this  critical  artificial  Intelligence 
component  by  determining  the  potential  for 
different  representational  systems  residing  and 
Interacting  within  a  single  expert  system. 


In  many  ways,  on-the-job  training  (OJT)  is  the 
critical  arena  in  which  training  technology  may 
have  the  greatest  potential  for  enhancing  the 
mission  readiness  of  Air  Force  personnel.  For 
example,  OJT  is  an  essential  ingredient  In  main¬ 
taining  adequate  skills  and  combat  readiness 
throughout  an  airman's  career.  Upgradina  to 
fully  qualified  skill  status  is  primarily  accom¬ 
plished  through  OJT.  The  Air  Force  OJT  program 
encompasses  enlisted  personnel  with  widely 
diverse  aptitudes  and  backgrounds.  In  addition 
to  encompassing  all  enlisted  personnel.  Air 
Force  OJT  involves  all  specialties  and  affects 
all  command  missions.  At  any  given  time,  more 
than  80,000  airmen  In  over  300  specialties  are 
participating  In  OJT  upgrade/qualification 
training.  The  Importance,  scope,  and  diversity 
of  the  OJT  program  result  in  a  variety  of  prob¬ 
lems  from  both  a  training  and  a  management 
standpoint  and  make  OJT  both  expensive  and  dif¬ 
ficult  to  manage. 

Advanced  On-The-Job  Training  System 

The  Training  Systems  Division  has  established 
an  operating  location  at  Bergstrom  AFB,  Texas, 
to  address  both  the  way  the  Air  Force  develops 
and  conducts  OJT  and  the  way  it  keeps  track  of 
the  skill  status  of  the  airmen  in  and  out  of  the 
system.  The  4-year  Advanced  On-The-Job  Training 
System  (AOTS)  project  will  systematically  de¬ 
sign,  develop,  and  test  a  prototype  that  applies 
state-of-the-art  technology  to  OJT.  The  AOTS 
Is  composed  of  four  subsystems,  and  each  in¬ 
cludes  a  set  of  related  components  designed  to 
accomplish  those  functions  required  for  the 
development  and  operation  of  an  effective  OJT 
system.  Four  systems  comprise  the  AOTS:  (a) 
management,  (b)  evaluation,  (c)  computer  sup¬ 
port,  and  (d)  personnel  and  support  require¬ 
ments  for  the  system.  The  AOTS  subsystems  will 
be  Integrated  Into  a  total  functional  system 
that  will  be  demonstrated  and  tested  to  deter¬ 
mine  Its  operational  capabilities  as  a  prototype 
OJT  system.  The  system  will  be  developed,  de¬ 
monstrated  and  tested  In  a  1-year  side-by-side 
comparison  versus  the  current  OJT  system,  all 
within  the  work  centers  of  an  operational  wing. 
The  system  design,  development,  and  evaluation 
will  Include  the  active  Air  Force,  the  Air  Force 
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Reserve,  and  the  Air  National  Guard,  The  devel¬ 
opment  contractor  is  currently  on-site  at 
Bergstrom  AFB  and  is  beginning  the  Initial 
design  and  critical  design  reviews.  Upon 
successful  acceptance  testing,  the  AOTS  should 
provide  the  Air  Force  with  a  sophisticated 
systems  approach  to  ensuring  mission  readiness 
with  capabilities  for  the  identification  of 
performance  and  training  requirements,  manage¬ 
ment  of  job-site  training,  evaluation  of  airman 
task  performance,  evaluation  of  training  program 
effectiveness,  and  OJT  management  analysis  data 
provided  to  appropriate  Air  Force  training 
management  levels. 

COURSE  DESIGN  AND  PERFORMANCE  EVALUATION 


tween  advanced  methods  of  task  analysis  and  Air 
Force  environments,  and  an  adjunct  to  human 
decision  making.  The  objective  of  this  effort 
is  to  develop  a  cognitive  model  ot  the  task 
analysis  process  and  then  to  design,  develop, 
and  test  an  integrated  set  of  computer-based 
aids  (based  on  this  model)  for  task  analysis  to 
support  training  in  the  job  environment. 

This  development  of  this  automated  task  analysis 
support  capability  will  provide  a  powerful  tool 
for  the  systematic  analysis  of  job  requirements 
and  their  subsequent  translation  to  training 
requirements.  This  task  will  be  especially 
suitable  for  utilization  by  subject-matter 
experts . 


The  effective  use  of  any  innovative  training 
technology  requires  that  the  standards  for  suc¬ 
cess  be  validly  identified  so  the  correct  behav¬ 
ior  can  be  trained,  and  once  completed,  the 
effect  of  the  training  can  be  judged.  ICAI  is 
one  approach  to  the  establishment  of  effective 
training  and  to  the  assessment  of  the  require¬ 
ments  of  the  learner.  Other  approaches  involve 
development  of  computer-aided  models  and  aids 
for  systematic  course  design,  as  well  as  devel¬ 
opment  of  valid  alternatives  to  assessing  train¬ 
ing  outcomes. 

Computer-Aided  Task  Analysis 


Task  analysis  methods  and  databases  as  current¬ 
ly  used  do  not  adequately  support  training 
design  and  development.  There  is  a  great  dis¬ 
parity  between  methods  of  task  analysis  based 
on  equipment  design  versus  methods  based  on 
occupational  survey  methods.  Computer-based  aids 
are  needed  to  provide  a  better  interface 
between  existing  databases,  a  better  fit  be- 


Operational  Unit  Job  Proficiency  Assessment 


The  development  of  a  valid,  general izable 
methodology  for  assessing  task  performance  pro¬ 
ficiency  in  a  day-to-day,  operational  environ¬ 
ment  is  a  critical  element  in  assessing  the 
effects  of  large-scale  training  innovations, 
such  as  the  AOTS.  Such  a  metnodology  is  also 
essential  in  monitoring  the  job/mission  readi¬ 
ness  of  personnel.  This  effort  will  develop  a 
task-sampling  methodology  appropriate  for  making 
valid  Inferences  to  the  task  population  within 
a  given  Air  Force  specialty.  Also,  a  complete 
measurement  scoring  methodology  is  to  be  devel¬ 
oped  to  gauge  the  job  readiness  of  the  targeted 
specialty.  This  effort  will  provide  a  critical 
link  for  measuring  performance  proficiency  by 
developing  a  methodology  appropriate  for  opera¬ 
tional  settings,  such  as  on-the-job  training. 
Thus,  it  will  serve  vital  job  certification  and 
quality  control  functions  essential  to  ensure 
mission  readiness. 


Further  information  on  any  of  these  projects  is  available 
from  the  points  of  contact  listed  on  page  81. 
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TECHNICAL  SERVICES  DIVISION 


The  Technical  Services  Division,  located  at 
Brooks,  provides  support  to  AFHRL  Headquarters 
and  the  four  R&D  divisions.  This  support 
includes  the  management  and  operation  of  the 
scientific  data-processing  center  of  AFHRL.  The 
Division  develops,  maintains,  and  updates 
automated  personnel  and  training  R&D  databases. 
The  Division  also  provides  consultative  and 
programming  support  in  the  formulation  of 
studies  and  the  application  of  statistical 
techniques  in  support  of  other  Laboratory  Divi¬ 
sions  and  other  Air  Force  offices.  The  major 
organizational  elements  within  the  Division  are 
the  Computer  Programming  Branch  and  the  Computer 
Operations  Branch.  The  Division  also  includes 
the  Information  Resources  Management  Office, 
and  the  Scientific  and  Technical  Information 
Office. 


Dr.  Robert  A.  Bottenberg 
Division  Chief 


COMPUTER  PROGRAMMING  BRANCH 

The  Computer  Programming  Branch  provides  three 
services : 

1.  Software  Development. 

2.  Database  Management. 

3.  Research  Processing. 


Software  Development.  The  Technical  Services 
Division  develops,  maintains,  documents,  and 
provides  training  in  the  use  of  general  purpose 
computer  software.  This  software  includes  the 
broad  categories  of  (a)  language  translators, 
such  as  precompilers  and  interpreters,  (b) 
utility  programs,  such  as  sort/merge  and  report 
writers,  (c)  applications  programs,  such  as 
correlation-regression  analysis  and  multi¬ 
dimensional  frequency  distributions,  and  Id) 
subroutine  libraries  containing  common 
computing  algorithms.  The  Technical  Services 
Division  is  responsible  for  more  than  460 
general  purpose  and  statistical  analysis 
programs  and  over  3,080  pages  of  user  guides  to 
those  programs. 

Database  Management.  The  Human  Resources 
Laboratory  database  is  composed  of  a  series  of 
databases  containing  information  on  personnel 
and  training  systems.  These  data  are  organized 
into  readily  accessible  databases  for  support 
of  R&D  studies  of  the  personnel  system,  to 
display  selected  information  from  a  single 
database,  and  to  consolidate  information  on  a 
common  subgroup  from  two  or  more  databases. 
These  data  reflect  personal  characteristics  on 
officer  and  enlisted  personnel  at  time  of  entry 
to  active  duty,  performance  outcomes  during 
flying  or  technical  training,  career  status  at 
periodic  intervals,  and  information  related  to 
reenlistment  or  separation.  Special  files  will 
be  created  to  meet  long-term  study 
requirements,  and  longitudinal  files  will  be 
constructed  to  facilitate  studies  in  career 
development.  Work  is  underway  to  build  dynamic 
database  systems  for  officers  and  airmen 
capable  of  providing  responses  to  operational 
and  research  Investigators.  These  database 
systems  will  eliminate  the  requirements  for 
many  small,  fragmented  databases  and  greatly 
reduce  the  start-up  time  and  cost  of  many 
personnel  R&D  efforts. 

Major  master  personnel  files  are  maintained 
historically  on  Air  Force  enlisted  and  officer 
personnel  and  include  enlisted  strength  files 
from  1964,  officer  strength  files  from  1960, 
officer  effectiveness  report  files  from  1956, 
flying  training  files  from  1964,  and  Air 
National  Guard  and  Reserve  files  from  1970. 
These  files  are  received  from  various  Air  Force 
agencies,  such  as  the  Air  Force  Manpower  and 
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Personnel  Center,  Air  Training  Command,  Air 
University,  and  Air  Reserve  Personnel  Center. 
Special  longitudinal  files,  such  as  the  airman 
gain/loss  and  officer  gain/loss,  are  developed 
in-house  from  these  databases  and  significantly 
reduce  data  processing  requirements  in  many 
personnel  and  training  R&D  studies. 


Research  Processing.  The  AFHRL  Technical 
Services  Division  provides  large-scale  statis¬ 
tical  services  and  data-processing  support  for 
Laboratory  R&D  programs.  These  services  are 
performed  in  response  to  approved  work  requests 
initiated  by  all  AFHRL  divisions.  These  same 
services  are  available  to  approved  agencies 
outside  AFHRL.  Work  requests  are  Initiated  on 
behalf  of  the  outside  customers  and  then  pro¬ 
cessed  in  the  same  manner  as  those  for  the 
AFHRL  divisions.  In  addition  to  processing 
these  work  requests,  the  Division  performs  a 
quality  review  of  all  work  performed  to  ensure 
complete  and  accurate  results.  Annually,  the 
Division  services  over  200  R&D  data  processing 
requests. 


COMPUTER  OPERATIONS  BRANCH 


The  Computer  Operations  Branch  manages  and 
operates  a  Computer  Center  which  includes  a 
large-scale,  general-purpose  Sperry  1100 
computer  system  to  support  R&D  programs  of 
AFHRL  and  the  Aerospace  Medical  Division  (AMD) 


at  Brooks  AFB,  the  Occupational  Measurement 
Center  (OMC)  and  the  Air  Force  Manpower  and 
Personnel  Center  (AFMPC)  at  Randolph  AFB.  A 
Digital  Equipment  Corporation  VAX  11/780 
computer  system  provides  Automated  Management 
Information  Systems  in  support  of  R&D  projects 
within  AFHRL  and  also  provides  an  interface 
with  the  Defense  Data  Network  (DDN).  A  Hang 
Laboratories  VS  90  computer  system  provides 
office  automation  support  within  AFHRL. 

The  Computer  Center  includes  a  magnetic  tape 
library  which  houses  between  15,000  and  20,000 
active  tape  reels.  These  tape  reels  contain 
historical  data  from  Air  Force  personnel  files 
which  Include  master  files,  working  files 
created  in  the  conduct  of  data  processing  work 
requests,  and  system  and  application  software. 

The  Sperry  1100  computer  system  provides  the 
computer  capability  needed  to  support  the  R&D 
projects  of  the  Laboratory.  The  Sperry  1100 
system  supports  major  programming  languages 
including  FORTRAN,  COBOL,  and  database 
management  systems  including  Sperry's  DMS  1100 
and  System  2000.  There  are  over  300  people 
authorized  use  of  the  1100  System  via  dial-up 
telephone  lines,  dedicated  telephone  lines 
(servicing  Williams  AFB  and  Randolph  AFB),  and 
direct  connected  terminals  at  AFHRL,  Brooks. 
Sperry  1100  users  include  AFHRL  and  AMD 
scientists  and  contractors,  as  well  as  survey 
analysts  from  OMC  and  AFMPC. 

The  VAX  11/780  computer  system,  using  the 
Oracle  Data  Base  Management  System  (DBMS), 
provides  automated  Management  Information 
Systems  (MIS)  In  direct  support  of  R&D  projects 
within  AFHRL.  Presently,  personnel  throughout 
AFHRL  use  the  System  2000  DBMS  on  the  Sperry 
1100  system  to  support  MIS  requirements.  All 
MIS  presently  on  the  Sperry  1100  computer  will 
be  transitioned  to  the  VAX  11/780. 

The  Hang  VS  90  computer  system  provides  office 
automation  support  within  AFHRL.  This  system 
provides  local  automated  word  processing 
capability  and  electronic  mail  service  to  the 
remote  AFHRL  divisions  and  HQ  AFSC.  The  Wang 
terminals  and  printers  located  throughout  AFHRL 
(Bldg  578)  allow  users  to  create,  edU,  reuse 
and  print  research  reports,  correspondence, 
etc.  and  store  documents  on  magnetic  disks  for 
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later  retrieval  as  needed.  The  electronic  mail 
function  allows  transmission  of  correspondence, 
research  reports,  etc.  to  all  AFHRL  divisions 
and  HQ  AFSC. 

SCIENTIFIC  AND  TECHNICAL  INFORMATION  OFFICE 

The  Scientific  and  Technical  Information 
(STINFO)  Office  plans  and  directs  the  STINFO 
program,  including  the  Technical  Library,  to 
meet  the  information  needs  of  Laboratory 
scientists  and  technicians  In  managing, 
monitoring,  and  conducting  R&D,  as  well  as  to 
publicize  the  work  of  the  Laboratory  and  its 
achievements.  STINFO  personnel  identify  the 
information  and  publicity  needs  of  the 
Laboratory  and  develop  news  articles,  news¬ 
letters,  reports,  brochures,  and  displays  to 
meet  those  needs.  The  Office's  Technical 
Editing  function  reviews,  processes,  and 
publishes  results  of  R&D  projects  in  the  form 
of  technical  reports,  journal  articles,  special 
reports,  professional  papers,  and  other 
documents.  Technical  Editing  personnel  provide 
guidance  to  authors  and  contract  monitors  to 
ensure  that  publications  comply  with  Government 
regulations  and  professional  standards.  They 
also  monitor  distribution  of  AFHRL  publications 
and  maintain  records  for  responding  to  informa¬ 
tional  requests  from  the  user  and  scientific 
communities.  The  Office  provides  liaison 
services  between  the  AMD  Public  Affairs  Office 
and  the  Laboratory.  The  Office  obtains 
clearance  of  information  for  public  release; 
arranges  for  visits  and  services  of  reporters, 
photographers,  and  audiovisual  specialists;  and 
performs  special  public  relations  and  informa¬ 
tion  assignments  as  required.  Finally,  the 
Office  maintains  the  AFHRL  historical  archives, 
answers  historical  Inquires,  and  provides 
information  for  the  AMD  History. 

Technical  Library 

The  services  provided  by  the  AFHRL  library 
Include  the  acquisition  of  books,  journals,  and 
other  library  materials.  Services  are  provided 
for  the  command  staff  offices  and  the  divisions 
on  Brooks  AFB,  as  well  as  for  divisions  and 
offices  located  in  other  geographical  areas. 
The  library  has  on-line  access  to  the  Dialog 
Information  Services,  Inc.,  at  Palo  Alto, 
California;  the  Defense  Technical  Information 


Center's  Defense  RDT&E  On-Line  System,  at 
Alexandria,  Virginia;  and  the  OCLC,  a  national 
library  network,  through  the  AMIGOS  Biblio¬ 
graphic  Council,  Inc.,  Dallas,  Texas.  During 
the  fiscal  year,  the  Library  staff  accomplished 
191  on-line  literature  searches. 


Library  holdings  at  the  end  of  FY85  were  13,400 
books  and  bound  volumes  of  journals,  10,862 
technical  reports  and  470  journal  subscriptions. 


INFORMATION  RESOURCES  MANAGEMENT  OFFICE 

Audio  and  Video/Graphics  Teleconferencing 

Since  July  1984,  all  the  remote  divisions  of 
AFHRL  and  the  headquarters  are  equipped  with  a 
video/graphics  teleconferencing  system.  This 
system  simultaneously  links  all  the  AFHRL 
sites,  thereby  providing  for  a  fully  inter¬ 
active,  multipoint  video/graphics  telecon¬ 
ference.  The  system  is  capable  of  creating, 
storing,  and  retrieving  digital  color  imagery 
consisting  of  text,  graphs,  and/or  photographs 
and  subsequently  displaying  these  Images 
locally  on  large  screen  display  systems  or  on 
color  monitors.  Using  this  system,  full-scale 
audio  and  color  video  teleconferences  can  be 
conducted  using  a  normal  telephone  access  line. 
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Management  Information  System 

The  Information  Resources  Management  Office  Is 
also  the  focal  point  for  collecting  and 
displaying  data  used  In  the  management  of  the 
AFHRL  technical  program.  The  software  for 
Input  of  data  at  the  source  has  been  com* 
pleted.  All  the  divisions  are  now  on  line  to 
Input  and  retrieve  work  unit,  JOCAS,  and  TOY 
source  data  for  MIS  products.  Automated  data 
transfer  is  being  done  for  data  to  support  DOD 
and  AFSC  databases.  Personnel  throughout  AFHRL 
retrieve  data  and  produce  reports  using  the 
AFHRL  database  and  System  2000.  The  Office  can 
provide  various  types  of  color  output,  such  as 
textual  slides,  pie  charts,  bar  graphs,  and 
line  graphs,  suitable  for  vlewgraph  and  35mm 
projection. 


FY85  ACCOMPLISHMENTS 

Several  special  studies  were  conducted  for  USAF 
Headquarters  and  MAJCOM  Headquarters  offices. 
A  study  conducted  for  HQ  USAF/MPAC  developed 
retention  and  continuation  rates  for  enlisted 
accessions  In  each  of  the  years  1974-1983,  with 
data  broken  out  In  various  demographic  catego¬ 
ries.  In  another  study  for  HQ  AFSC,  promotion 
statistics  were  analyzed  for  staff  sergeant, 
technical  sergeant,  and  master  sergeant,  and 
data  were  provided  comparing  performance  of  Air 
Force  Systems  Command  NCOs  with  NCOs  from  other 
Major  Commands  on  the  six  factors  In  the 
Weighted  Airman  Promotion  System.  A  series  of 
studies  comparing  line  officer  promotion  rates 
for  captains,  majors,  and  lieutenant  colonels 
within  the  Aerospace  Medical  Division,  Air  Force 
Systems  Command,  and  total  Air  Force  were  com¬ 
pleted.  These  studies  Included  promotion 
statistics  over  the  past  10  years,  and  focused 
on  several  background  factors  such  as  Profes¬ 
sional  Military  Education,  education  level, 
general  officer  endorsements,  and  the  ratee's 
Air  Force  specialty.  Other  studies  on  officer 
retention  were  carried  out  for  AFMPC/MPCMRS. 


Several  features  were  added  to  the  Advanced 
Technology  Multimedia  Communications  System. 
These  Included  multipoint  which  enables  a 
briefer  at  any  one  of  the  four  Laboratory  loca¬ 
tions  to  control  the  visual  display  on  the 
screen.  Other  features  enable  the  briefer  to 
Insert  handwriting  on  a  chart  being  displayed 
at  each  of  the  locations,  and  to  transmit  to  the 
various  sites  Images  captured  on  a  television 
camera.  Software  was  Installed  to  expand  the 
range  of  graphics  and  to  ease  the  task  of  pre¬ 
paring  graphics  material. 

Significant  progress  was  made  in  converting 
Laboratory  management  information  systems  from 
the  host  Sperry  1100  computer  to  the  VAX 
11/780.  Equipment  was  Installed  In  all  Labora¬ 
tory  divisions  to  support  access  and  retrieval 
of  data  from  the  VAX.  A  S12K-word  memory  module 
was  added  to  the  Sperry  1100  system  to  bring 
total  main  memory  to  2M  words.  Procurements 
were  Initiated  for  an  additional  Sperry  proces¬ 
sor,  and  delivery  orders  were  announced  for  a 
front-end  processor,  a  tape  subsystem  to  replace 
the  current  system,  and  a  major  expansion  to  the 
disk  subsystem.  Procurements  were  also  Initi¬ 
ated  to  upgrade  the  VAX  with  additional  memory, 
and  for  a  communications  network  which  will 
provide  VAX  access  to  a  large  number  of  users. 

An  effort  Is  near  completion,  In  which  a  large 
volume  of  data  processing  work  request  docu¬ 
mentation  has  been  converted  to  microfiche. 
Hard-copy  documentation  Is  being  staged  for 
destruction. 

Sixty-five  Laboratory  personnel  were  provided 
In-house  training.  Courses  In  19  functional 
areas  were  conducted.  Including  the  use  of 
personal  computers,  software  languages,  and  the 
application  of  utility  routines.  Software 
developed  In-house  was  copied  and  made  available 
to  requesters  from  other  Air  Force,  Federal, 
and  state  agencies. 
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COLONEL  JARVI  ASSUMES  AFHRL  COMMAND 


Colonel  Dennis  W.  Jarvl  assumed  command  of  AFHRL 
June  17,  1985.  He  succeeds  Colonel  Anthony  F. 
Bronzo,  Jr.,  who  Is  now  Vice  Commander  of  the 
Aerospace  Medical  Division. 

Col  Jarvi,  a  native  of  Negaunee,  Michigan, 
graduated  from  Michigan  Technology  University 
with  a  Bachelor  of  Science  Degree  in  Mechanical 
Engineering.  In  1964,  he  entered  pilot  training 
at  Webb  AFB,  Texas.  Before  reporting  to  his 
first  assignment  flying  the  F-101  at  Charleston 
AFB,  South  Carolina,  Col  Jarvi  served  a  short 
stint  in  the  F—  1 02  at  Perrin  AFB,  Texas,  and  in 
the  F-101  training  program  at  Tyndall  AFB, 
Florida.  Flying  out  of  Korat  at  RTAFB,  Thai¬ 
land,  Col  Jarvi  flew  100  combat  missions  in  the 
F-105  over  North  Vietnam  in  1967-1968. 


Following  assignments  to  Kadena  Air  Base, 
Okinawa,  and  McConnell  AFB,  Kansas,  he  led  the 
USAF/German  Air  Force  Fighter  Weapons  School  at 
Luke  AFB,  Arizona,  flying  the  F-104.  Upon 
graduation  from  the  Canadian  Forces’  Command 
and  Staff  College  in  Toronto,  Canada,  in  1976, 
he  flew  the  F-104  with  the  NATO  Allies  in 
Europe.  In  1979,  Col  Jarvi  was  assigned  to 

Wright-Patterson  AFB,  Ohio,  as  Chief  of  the 

Crew  Station  and  Human  Factors  Division  in  the 

Directorate  for  Equipment  Engineering.  Later, 
he  became  the  program  director  of  a  classified 
advanced  aeronautical  system.  He  is  a  graduate 
of  the  Defense  Systems  Management  College  and 
Air  War  College  and  holds  an  MBA  from  the 

University  of  Utah. 
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COLONEL  NEWTON  AWARDED  THE  LEGION  OF  MERIT 


Colonel  Tyree  H.  Newton  was  awarded  the  Legion 
of  Merit  for  his  outstanding  service  as  Vice 
Commander  of  the  Air  Force  Human  Resources  Lab¬ 
oratory  from  15  August  1984  to  31  July  1985. 
On  many  occasions,  he  assumed  full  command  re¬ 
sponsibility  for  the  Laboratory,  with  the  com¬ 
plete  confidence  of  the  Commander.  He  prepared 
comprehensive  studies  and  directives  for  the 
functional  reorganization  and  realignment  of 
people,  resources,  and  programs  of  the  Labora¬ 
tory  Headquarters  and  Divisions.  His  guidance 
for  the  relocation  of  the  Training  Systems  Divi¬ 
sion  greatly  facilitated  the  Integration  of 
personnel  and  training  RSD  activities  of 
critical  Importance  to  the  Air  Force.  This 
movement  of  approximately  40  positions  will 


centralize  AFHRL  expertise  In  personnel  and 
training  R&D,  bring  these  services  closer  to 
primary  user  agencies,  and  be  accomplished  with 
the  least  possible  Impact  on  the  people 
Involved.  He  skillfully  coordinated  agreements 
and  facilities  with  Tactical  Air  Command 
headquarters  and  with  Bergstrom  AFB  officials 
to  initiate  the  Advanced  On-the-Job  Training 
System  RiD  project,  which  will  have  a  tremen¬ 
dous  payoff  for  Air  Force  technical  training 
programs.  He  supervised  the  merger  of  the 
Scientific  and  Technical  Information  Office  and 
the  Technical  Editing  Office,  which  Improved 
the  utilization  of  resources  and  strengthened 
the  AFHRL  scientific  and  technical  information 
program. 


DR.  CHRISTAL  WINS  DONALD  B.  HAINES  AWARD 


MANAGEMENT  AWARD  TO  COL  TETMEYER  AND  DR.  VITOLA 


Dr.  Raymond  E.  Christa! 


The  AFHRL  Management  Award  for  FY85  was  con¬ 
ferred  jointly  on  Colonel  Donald  C.  Tetmeyer, 
Chief  of  the  AFHRL  Logistics  and  Human  Factors 
Division  (LR),  and  on  Dr.  Nancy  Guinn  Vltola  of 
the  AFHRL  Manpower  and  Personnel  Division. 

Col  Tetmeyer's  accomplishments  have  had,  and 
continue  to  have,  a  major  impact  on  the 
readiness  support  capability  of  fielded  and 
future  Air  Force  weapon  systems.  The 
redirection  of  the  Division's  RSD  program  into 
the  logistics  area  has  greatly  enhanced  the 
Laboratory's  ability  to  directly  help  improve 
the  supportabi 1 ity  of  Air  Force  weapon 
systems.  Col  Tetmeyer  achieved  this 
redirection  by  Integrating  his  knowledge  of  Air 
Force  needs  to  improve  weapon  system 
supportabi 1 Ity;  his  professional  knowledge  and 
technical  skills  In  the  areas  of  operations 
research,  engineering,  and  behavioral  science; 
and  his  analysis  of  the  needs  of  the  logistics 
community. 


The  AFHRL  Donald  B.  Haines  Award  for  FY85  was 
granted  to  Dr.  Raymond  E.  Chrlstal  of  the  Man¬ 
power  and  Personnel  Division.  Dr.  Chrlstal  has 
developed  at  AFHRL  the  technical  foundation  for 
what  Is  fast  becoming  an  internationally  recog¬ 
nized  Center  of  Excellence  In  Cognitive  Ability 
Research.  He  has  been  primarily  responsible  for 
Initiating  and  providing  technical  direction  and 
leadership  for  basic  research  In  the  Learning 
Abilities  Measurement  Program  (LAMP). 

Project  LAMP  is  unique  in  the  DOD  and  reflects 
the  belief  that  there  exists  a  window  of  oppor¬ 
tunity  for  significant  and  dramatic  advances  in 
the  area  of  assessing  human  abilities.  Micro¬ 
computers  have  become  generally  available  to 
provide  the  capacity  for  measuring  unique 
aspects  of  mental  functioning.  Artificial 
Intelligence  researchers  have  provided  the  means 
for  developing  sophisticated  tutoring  courses 
that  yield  measures  of  Individual  learning 
efficiency  suitable  for  use  as  criterion  meas¬ 
ures.  Cognitive  psychologists  have  been  making 
progress  In  identifying  the  fundamental  compo¬ 
nents  of  human  cognition.  Results  from  this 
work  should  alter  significantly  the  tests  used 
to  evaluate  applicants  to  military  service  In 
the  1990s  and  beyond. 


Colonel  Donald  C.  Tetmeyer 
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The  Integration  of  the  R&D  programs  of  the  LR 
Division  with  other  R&D  progi  ^ms  has  the  bene¬ 
fits  of  cross-fertilization  of  Ideas,  avoiding 
duplication  of  work,  and  cost-sharing  of  expen¬ 
sive  efforts.  Col  Tetmeyer  redefined  the  skill 
mix  of  his  staff  to  Include  multi-discipline 
teams  (operations  research  analysts,  computer 
scientists,  engineers,  and  behavioral  scien¬ 
tists)  and  to  Include  a  greater  proportion  of 
military  personnel  with  field  experience.  These 
changes  have  given  the  LR  Division  a  far  greater 
capability  to  accomplish  the  high-technology  R&D 
that  Is  in  Its  new  mission. 

Dr.  Nancy  Guinn  Vltola  shared  the  AFHRL  Manage¬ 
ment  Award  with  Colonel  Tetmeyer.  Her  excep¬ 
tional  performance  as  Technical  Director  and 
Division  Chief,  Manpower  and  Personnel  Division 
was  cited  as  the  basis  for  this  award.  Using 
extraordinary  management  and  technical  skills, 
a  keen  understanding  of  Air  Force  needs,  and  a 
deep  understanding  of  how  emerging  technology 
can  support  those  needs.  Dr.  Vltola  has  devel¬ 
oped  the  broadest  and  most  comprehensive  R&D 
program  of  Its  kind  In  the  DOD.  During  the  year 
she  served  as  its  Chief,  the  Manpower  and 
Personnel  Division  began  a  7-year  program  to 
measure  the  success  of  on-the-job  performance 
of  thousands  of  military  personnel.  The 
results  of  this  work  will  have  far-reaching 
consequences  throughout  the  DOD. 

Under  Dr.  Vltola's  direction,  a  multi-mi  1 1 Ion- 
dollar  research  program  was  Initiated  to  ad¬ 
dress  the  critical  issue  of  what  knowledge  Is 
required  by  apprentice  airmen  to  perform  their 
jobs  successfully  and  to  progress  In  their  later 
careers.  The  conceptual  design  of  this  work 
extends  far  beyond  simple  literacy  skills  and 
Is  now  envisioned  to  Include  all  higher  order 
cognitive  skills  necessary  to  operate  In  a  high- 
technology  environment.  The  results  of  this 
work  could  revolutionize  the  way  that  Air  Force 
technical  training  programs  are  designed. 


MERITORIOUS  CIVILIAN  SERVICE  AWARD 
TO  DR.  NANCY  GUINN  VITOLA 


Dr.  Nancy  Guinn  Vitola  received  the  Air  Force 
Award  for  Meritorious  Civilian  Service  for 
exceptional  performance  as  Technical  Director 
and  Chief,  Manpower  and  Personnel  Division  from 
1  April  1984  to  1  April  1985.  During  that  time 
she  was  responsible  for  direct  management  of  87 
technical  and  support  personnel  assigned  to  the 
Division  and  an  approximate  annual  budget  of  5 
million  dollars.  The  personal  efforts  and 
contributions  of  Dr.  Vltola  pervade  the 
Division's  entire  R&D  program.  “Through  her 
technical  leadership  and  skilled  management,  a 
working  environment  has  been  established  In 
which  major  scientific  programs  of  direct 
relevance  to  the  Air  Force  can  be  designed, 
funded,  and  executed  according  to  the  highest 
professional  standards.  Dr.  Vitola' s  personal 
Integrity,  competence,  and  foresight  form  the 
cornerstone  of  the  Division." 


DR.  SHERRI  P.  GOTT'S  PAPER  CITED  AS  BEST 


DAN  BERKANT  AWARD  GOES  TO  MS.  SALVATIERRA 


Sherri  P.  Gott 


Dr.  Sherri  P.  Gott  recently  received  the  Air 
Force  Systems  Command  Certificate  of  Merit. 
Brigadier  General  Charles  F.  Stebbins,  Deputy 
Chief  of  Staff  for  Science  and  Technology 
(AFSC),  cited  Dr.  Gott'S  coauthorship  of  the 
paper  "Complex  Systems  in  the  Workplace:  What 
do  Technicians  Really  Need  to  Know?"  as 
deserving  of  this  recognition.  Dr.  Gott'S  paper 
was  selected  as  the  best  Air  Force  paper  in  the 
Life  Sciences  and  Engineering  Symposium. 
Working  as  a  personnel  research  psychologist  in 


Ms.  Margie  A.  Salvatierra,  secretary  to  Dr. 
Alluisi,  the  Chief  Scientist  of  AFHRL ,  received 
the  1985  Dan  Berkant  Award  recognizing  outstand¬ 
ing  civilian  service  toward  the  achievement  of 
the  USAF  mission. 

Ms.  Salvatierra  is  a  native  Texan  and  a  career 
Civil  Service  employee.  She  received  her  degree 
in  mid-management  from  San  Antonio  College  and 
is  pursuing  a  bachelor's  degree  in  management 
at  Southwest  Texas  State  University. 

She  continuously  demonstrates  outstanding  lead¬ 
ership  and  management  of  Dr.  Alluisi's  office 
during  frequent  temporary  duty  absences  by  the 
Chief  Scientist.  She  is  often  required  to  make 
contact  with  local,  state,  and  Federal  offi¬ 
cials,  as  well  as  with  business,  educational, 
and  scientific  leaders.  Ms.  Salvatierra  has 
earned  Sustained  Superior  Performance  awards  for 
the  past  2  years.  A  member  of  the  Federally 
Employed  Women’s  Program,  Ms.  Salvatierra  has 
served  as  the  2nd  and  1st  vice  president  of  this 
organization. 


the  Manpower  and  Personnel  Division,  Dr.  Gott 
described  an  RSD  effort  to  design  a  system  for 
measuring  and  training  the  skills  that  are 
fundamental  to  early  proficiency  in  technology¬ 
laden  workplaces. 

Dr.  Gott  suggests  that  instructional  materials 
should  "provide  a  general  framework  and  concep¬ 
tual  model  up  front  to  Introduce  and  thus  har¬ 
ness  complex  sets  of  variables;  present  informa¬ 
tion  in  meaningful,  tightly  cohesive  chunks; 
model  chunks  after  the  naturally  occurring 
structures  that  are  known  to  characterize  a 
’earner's  developing  knowledge;  and  ...  target 
instruction  at  specifiable,  discrete  components 
within  a  complex  skill."  These  procedures  would 
seem  to  have  direct  application  to  the  utiliza¬ 
tion  of  artificial  intelligence  in  computer- 


based  instruction. 


Margie  A.  Salvatierra 
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AFHRL  CELEBRATES  ANNIVERSARY 


AFHRL  celebrated  Its  43rd  anniversary  15 
November  1984  with  a  2-day  open  house,  and  San 
Antonio  Mayor  Henry  G.  Cisneros  proclaimed  11 
to  17  November  “Air  Force  Human  Resources 
Laboratory  Meek."  The  open  house  Included 
briefings,  videotape  presentations,  and  techni¬ 
cal  demonstrations  by  Laboratory  personnel,  as 
well  as  an  Air  Force  Systems  Command  sound-slide 
presentation  in  the  Air  Force  Orientation  Group 
theater  van. 


rl 


1  ' 

K 


'?! 


BRIGADIER  GENERAL  DOPPELT  VISITS  AFHRL  DIVISIONS 


The  Commander  of  the  Aerospace  Medical  Division, 
Brigadier  General  Frederic  F.  Doppelt,  spent  two 
weeks  during  November/December  1984  visiting  all 
AFHRL  divisions.  Gen  Doppelt's  purpose  was  to 
get  to  know  the  people,  facilities,  and  programs 
of  the  Laboratory.  On  these  visits,  he  spent 
much  time  with  the  young  people,  both  military 
and  civilian. 

"There  is  no  question  but  that  our  young  people 
are  bright  and  excited  by  their  jobs,  and  they 
are  doing  a  tremendous  job,"  he  said. 

"Our  people  are  unique.  They  are  very  well 
trained.  They  know  what  they  want  to  do,  and 
they  know  where  they  are  going.  They  have  to 
be  the  best  caliber  of  people  that  I've  seen 
anywhere  in  my  career,"  added  Gen  Doppelt. 


FISCAL  HIGHLIGHTS 


FUNDING  SUMMARY  (1000) 


LABORATORY  DIRECTOR’S  FUND 
RESEARCH  6.1 

EXPLORATORY  DEVELOPMENT  6.2 

ADVANCED  DEVELOPMENT  6.3 

INTERSERVICE  TRANSFERS  & 
REIMBURSABLES 

TOTAL 


DISTRIBUTION  OF 
FUNDING 


Q  6.2  LABORATORY  DEVELOPMENT  (50%) 
B  6.1  RESEARCH  (2%) 

□  LABORATORY  DIRECTOR’S  FUND  (1%) 

□  INTERSERVICE  TRANS  &  REIMB  (16%) 

□  6.3  ADVANCED  DEVELOPMENT  (31%) 


FY83 

FY84 

FY85 

790 

815 

945 

1,156 

830 

752 

23,786 

29,421 

30,557 

16,789 

15,215 

19,291 

8,547 

10,966 

9,781 

51,068 

57,247 

61,326 

FUNDING  BY  DIVISION 
ALL  SOURCES 


□  OPERATIONSTRAINING  (21.9) 

B  TRAINING  SYSTEMS  (5.1) 

□  MANPOWER  &  PERSONNEL  (11.5) 

□  LOGISTICS  &  HUMAN  FACTORS  (23.0) 


UNCLASSIFIED  TECHNICAL  REPORTS  DISTRIBUTED  IN 

FY8S 

CAE  Electronics  Ltd.  Wide-f ield-of-view, 
helmet-mounted  infinity  display  system 
development^  AFHRL-TR-84-27  (AD-A149 641 ' . 

Dwyer,  D.  J.  An  exploratory  study  of  the  effect 
of  screen  size  and  resolution  on  the  legi¬ 
bility  of  graphics  in  automated  job  per¬ 
formance  aids.  AFHRL-TR-84-55  A 
NAVTRAEQUIPCEN  IH-355. 

Fairbank,  B.  A.,  Jr.  Equipercent i le  test 

equating:  The  effects  of  presmoothing  and 
postsmoothing  on  the  magnitude  of  sample- 
dependent  errors.  AFHRL-TR-84-64  (AD-A154 
110). 

Finegold,  L.  S.,  &  Rogers,  D.  L.  Relationship 
between  AFOQT  scores  and  success  in  air 
weapons  controller  training.  AFHRL-TR-85- 
13  (AD-A158  162). 

Gialluca,  K.  A.,  Crichton,  L.  I.,  Vale,  C.  D., 
&  Ree,  M.  J.  Methods  for  equating  mental 
tests.  AFHRL-TR-84-35  (AD-A149  544). 

Hughes,  R.  G.,  &  Brown,  L.  Trends  shaping  ad- 
vanced  aircrew  training  capabilities 
through  the  1990s.  AFHRL-TR-84-52 
(AD-A152  277). 

Jansen,  H.  P.  Training  emphasis  task  factor 
data:  Methods  of  analysis.  AFHRL-TR-84- 
50  (AD-A155  327). 

Kemner-R ichardson,  S.,  Lamos,  J.  P.,  &  West,  A. 
S.  Computer-assisted  instruction:  Decision 
handbook.  AFHRL-TR-84-46  (AD-A154  646). 

Kenyon,  R.  V.,  Zeevi,  Y.  Y.,  Wetzel,  P.  A.,  & 
Young,  L.  R.  Eye  movement  in  response  to 
single  and  multiple  targets.  AFHRL-TR-84- 
29  (AD-A151  115). 

Pieper,  W.  J.,  Richardson,  J.  J.,  Harmon,  K. 
R.,  Keller,  R.  A.,  &  Massey,  R.  H.  Inter- 
active  graphics  simulator:  Design,  de¬ 
velopment,  and  effectiveness/cost  evalua¬ 
tion.  AFHRL-TR-84-38  (AD-AH9  417). 


Preidis,  R.  J.  Computerized  technology  package- 
ASSET:  Test  and  evaluation.  AFHRL-TR-84-6 
( AD-A146  486). 


Rosemarie  J.  Preidis 


Reeker,  L.  H.,  Kreuter,  J.,  8  Wauchope,  K.  Ar- 
tificial  intelligence  in  Ada:  Pattern- 
directed  processing.  AFHRL-TR-85-12 
( AD-A156  230). 

Thomas,  G.  S.  Close  air  support  mission:  Devel- 
opment  of  a  unitary  measure  of  pilot 
performance .  AFHRL-TR-84-39  (AD-A149  285). 

Wainer,  H.,  8  Thissen,  D.  Estimating  ability 
with  the  wrong  model.  AFHRL-TR-84-45 
(AD-A154  071). 

Wegner,  T.  C,,  8  Ree,  M.  J.  Armed  Services 
Vocational  Aptitude  Battery:  Correcting 
the  speeded  subtests  for  the  1960  youth 
population^  AFHRL-TR-85-14  (AD-A158  823). 

Woodruff,  R.  R.,  Hubbard,  D.  C.,  8  Shaw,  A. 
Advanced  Simulator  for  Pilot  Training  and 
helmet-mounted  visual  display  configura¬ 
tion  comparisons.  AFHRL-TR-84-65  (AD-A155 

326)  . 
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Robert  R.  Woodruff 


UNCLASSIFIED  TECHNICAL  PAPERS  DISTRIBUTED  IN 

FY8S 

Bell,  H.  H.,  &  Cluffreda,  K.  J.  Advanced  Slrau- 
lator  for  Pilot  Training:  Effects  of 
col  1 Imlnat Ion  on  accommodation  and 
vergence.  AFHRL-TP-85-27. 

Brooks,  R.  B.  Radar  warning  receiver  special 
function  trainer:  Preliminary  evalua¬ 
tion.  AFHRL-TP-84-59  (AD-A155  021). 

Buescher,  R.  M.  Air  Force  Human  Resources  Lab- 
oratory  annual  report— fiscal  year  1984. 
AFHRL-TP-85-29  (AD-A156  918). 

Carroll,  R.  J.,  Goodman,  0.  L.,  Hrltz,  R.  J., 
Chlplock,  L.  W.,  &  Trump,  T.  R.  Malnte- 
nance  training  simulators:  Logistical 
support  cost  considerations  In  design  and 
acquisition^  AFHRL-TP-84-49  (AD-A152  168) . 

Collins,  D.  L.  Psychological  Issues  relevant 
to  astronaut  selection  for  long-duration 
space  flight:  A  review  of  the  litera¬ 
ture.  AFHRL-TP-84-4 1  (AD-A154  056). 

De  Malo,  J.,  Bell,  H.  H.,  S  Brunderman,  0. 
Pilot-oriented  performance  measurement. 


Geri,  G.  A.,  &  Zeevi,  Y.  Y.  Visual  phenomena 

produced  by  blnocularly  disparate  dynamic 
visual  noised  AFHRL-TP-85-4  (AD-A154  758). 

Gordon,  S.  E.  Manual  and  computer-aided  se¬ 
quential  diagnostic  Inference.  AFHRL-TP- 
84-51  (AD-A156  229). 

Gould,  R.  8.,  Black,  D.  E.,  &  Cummings,  W.  H. 
Air  Force  Civilian  Potential  Appraisal 
System:  Development.  AFHRL-TP-84-28 
( AD- A 1 48  909). 


Doris  E.  Black 


Guerrleri,  J.  A.,  Thompson,  N.  A.,  Cowan,  D.K., 
&  Gould,  R.  B.  Air  Force  Job  Performance 
Appraisal  System.  AFHRL-TP-  84-20 
(AD-A147  955). 

Hrltz,  R.  J.,  &  Purlfoy,  G.  R.,  Jr.  Mainte¬ 

nance  training  equipment:  Design  specifi¬ 
cation  based  on  Instructional  system 
development  AFHRL-TP-84-43  (AD-A149  405). 

Hrltz,  R.  J.,  Purlfoy,  G.  R.,  Jr.,  & 

Fitzpatrick,  J.  A.  Maintenance  training 
simulators  prime  Item  development  specifi¬ 
cation:  Model  specification  and  hand¬ 
book"!  AFHRL-TP-84-44  (AD-A154  108). 


AFHRL-TP-85-18  (AD-A158  849). 


Ree,  M.  J., 


Kyllonen,  P.  C.  Dimensions  of  information  pro¬ 
cessing  speeZ  AFHRL-TP-84-56  (AD-AI54 
778  ) . 


Martin,  E.  L.  Practice  makes  perfect.  AFHRL- 
TP-84-32  (AD-A147  124). 

McCombs,  B.,  4  Lockhart,  K.  A.  Personnel  roles 
and  requirements  for  non-conventional  in¬ 
struction  in  Air  Force  technical  training. 
AFHRL-TP-84-40  (AD-A149  4)2). 


O'Connor,  E.  J.,  Peters,  L.  H.,  Eulberg,  J.  R., 
&  Watson,  T.  W.  Situational  constraints 
in  the  Air  Force:  Identification,  mea¬ 
surement,  and  impact  on  work  outcomes. 
AFHRL-TP-84-10  (AD-A149  316). 


Thomas  W.  Watson 


V  a  I  CM  w  I  MC  f  L.  • 


A.  The  1980  youth  population:  A  verifi¬ 
cation  report.  AFHRL-TP-84-47  (AD-A153 
821). 


Lonnie  D.  Valentine,  Jr. 


Rogers,  0.  L.  Screening  composites  for  Air 
Force  officers.  AFHRL-TP-85-2  (AD-A154 
315). 

Saving,  T.  R.,  Stone,  B.  M.,  Looper,  L.  T.,  J 
Taylor,  J.  N.  Retention  of  Air  Force  en¬ 
listed  personnel:  An  empirical  examina¬ 
tion.  AFHRL-TP-85-6  (AD-A158  091). 


Summers,  R.  H.  Nondestructive  Inspection:  Ini' 
proved  capabilities  of  technicians.  AFHRL- 
TP-83-63  (AD-AI47  388). 


Owen,  0.  H.  Optical  flow  and  texture  variables 
useful  In  detecting  decelerating  and 
accelerating  self-motion.  AFHRL-TP-84-4 
(AD-A148  718). 

Park,  R.  K.,  Mathews,  J.  J.,  4  Ree,  M.  J. 

English  Diagnostic  Test:  Validation  for 
journalism-related  programs.  AFHRL-TP- 
85-8  ( AD-A155  734). 

Phelps,  M.  Low  altitude  texture  comparison  data 
base  and  smooth  shaded  texture.  AFHRL-TP- 
84-33  (AD-A150  342). 


Tuttle,  T.  C.,  Wilkinson,  R.  E.,  4  Matthews 
M.  D.  Field  test  of  the  methodology  for 
generating  efficiency  and  effectiveness 
measures.  AFHRL-TP-84-54  (AD-A158  183). 

Ward,  J.  H.,  Jr.,  Treat,  B.  R.,  4  Albert,  W.  G 
General  applications  of  hierarchical 
group-  Ing  using  the  HIER-GRP  computer 
program"  AFHRL-TP-84-42  (AD-A150  266) 


PAPERS  PUBLISHED  IN  FY85 


Arth,  T.  0.  (1984,  November).  Validation  of 

the  AFOQT.  Proceedings  of  the  26th  Annual 
Military  Testing  Association  Conference, 
Munich,  Federal  Republic  of  Germany. 

Askren,  U.  B.  (1985,  April).  New  role  for 
human  factors  in  equipment  design.  Human 
Factors  Society  Bulletin,  28(24) . 

Ellingsworth,  M.  E.  (1985,  May).  Occupational 
research  data  bank.  Proceedings  of  the  5th 
International  Occupational  Analysts 
Workshop,  Randolph  AFB,  TX. 

Eulberg,  J.R.,  Peters,  L.  H.,  O'Connor,  E.J.,  & 
Watson,  T.  W.  (1984,  December)  Situa¬ 
tional  performance  constraints:  A 
selective  review  of  relevant  literature. 
Psychological  Documents,  14,  30. 

Fairbank,  B.  A.,  Jr.,  Tirre,  W.  C.,  &  Anderson, 
N.  (1984,  December).  Measures  of  thirty 
cognitive  tasks:  Analysis  of  Relia- 
bilities.  Intercorrelations,  and  correla- 
tions  with  aptitude  battery  scores.  NATO 
Advanced  Study  Institute  on  Advances  in 
Measuring  Cognition  and  Motivation,  Athens, 
Greece. 

Horton,  T.  R.,  &  Gott,  S.  P.  (1985,  May). 
Cognitive  task  analysis  -  an  extension  of 
traditional  task  analysis.  Proceedings  of 
the  5th  International  Occupational  Analysts 
Workshop,  Randolph  AFB,  TX. 

Kantor,  J.  E.,  S  Bordelon,  V.  P.  (1985,  March). 
The  USAF  Pilot  Selection  and  Classification 
Research  Program.  Aviation  Psychology 
Symposium:  II.  Aviation,  Space  and 
Environmental  Medicine,  56,  258-61. 

Kyllonen,  P.  C.  (1985).  Theory-based  cognitive 
assessment.  In  J.  Zeidner  (Ed.),  Human 
productivity  enhancement:  Vol.  2. 
Acquisition  and  development  of  personnel. 

New  York:  Praeger. 

Kyllonen,  P.  C.,  &  Allulsi,  E.  A.  (1985). 
Learning  and  forgetting  facts  and  skills. 

In  G.  Salvendy  (Ed.),  Handbook  of  human 
factors/ergonomics.  New  York:  Wiley. 


Thomas  0.  Arth 


William  B.  Askren 


Jeffrey  E.  Kantor 
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Lawson,  K.  L.,  J  Martin,  T.  J.  (1984, 

November).  Improved  Selection  Procedures 
for  Air  Force  Physicians.  Proceedings  of 
the  26th  Annual  Military  Testing 


Association  Conference,  Munich,  Federal 
Republic  of  Germany. 

Lipscomb,  M.S.,  Whetzel,  0.,  S  Friedman,  D. 
(1984,  November).  A  comparison  of  task- 
based  performance  assessment  measures. 
Proceedings  of  the  26th  Annual  Military 
Testing  Association  Conference,  Munich, 
Federal  Republic  of  Germany. 

Massey,  R.  H.  (1985,  April).  Interactive 
graphics-simulator:  A  training/cost- 
effective  avionics  maintenance  trainer. 
Paper  presented  at  the  Armed  Forces 
Technology  in  Training  and  Education 
Conference,  Colorado  Springs,  CO. 

Payne,  0.  L.,  Christal,  R.  E.,  &  Kyllonen,  P.  C. 
(in  press).  The  Air  Force  Learning 
Abilities  Measurement  Program  (LAMP).  In 
T,  Sticht,  F.  Chang,  &  S.  Hood  (Eds.), 
Advances  in  reading/language  Research:  Vol. 
IV.  Greenwich,  CT :  JAI  Press. 


Randy  H.  Massey 

Pennell,  R.  (1985,  January).  Cost  variables  and 
a  cost  estimating  model  for  anticipating 
simulator  acquisition  cost.  Proceedings  of 
the  Symposium  on  the  Military  Value  and 
Cost-Effectiveness  of  Training.  Brussels, 
Belgium:  Defence  Research  Group,  NATO. 


Phalen,  W.  J.  (1985,  May).  Performance 
emphasis:  An  alternative  to  percent  time 
spent.  Proceedings  of  the  5th  Inter- 
national  Occupational  Analysts  Workshop, 


Randolph  AFB,  TX. 

Phalen,  W.  J.  (1985,  May).  CORSET  seminar. 
Proceedings  of  the  5th  International 
Occupational  Analysts  Workshop,  Randolph 
AFB,  TX. 

Phalen,  W.  J.,  Weissmuller,  J.  J.,  &  Staley, 
M.  R.  (1985,  May).  Advanced  CODAP:  New 
analysis  capabilities.  Proceedings  of  the 
5th  International  Occupational  Analysts 
Workshop,  Randolph  AFB,  TX. 

Quebe,  J.  C.  (1985,  September).  Research  and 
development  on  USAF  Flight  Screening 
Program  (FSP).  Proceedings  of  the 
Euro-NATO  Aircrew  Selection  Working  Group, 
Athens,  Greece. 
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John  C.  Quebe 


Rue,  R.  C.,  &  Rosenshine,  M.  (1985,  May).  T 
application  of  semi-Markov  decision  pro¬ 
cesses  to  queueing  of  aircraft  for  landing 
at  an  airport.  Transportation  Science,  19 
154-172.  "  '  “ 


Staley,  M.  R.,  Weissmuller,  J.  J.,  &  Phalen, 
W.  J.  (1985,  May).  ASCII  CODAP:  The  im¬ 
pact  of  system  design  for  emerging  appli¬ 
cations.  Proceedings  of  the  5th  Inter- 
national  Occupational  Analysts  Workshop, 
Randolph  AFB ,  TX. 

Short,  L.  0.,  Hightower,  J.  M.,  &  Snow,  J.  P. 
(in  press).  Air  Force  management  consulta¬ 
tion:  Survey  feedback  in  a  complex 
system.  Journal  of  Management  Consultation. 

Skinner,  M.  J.  (1984,  November).  Aptitude 
selectors  of  minuteman  missile  combat  crew 
duty.  Proceedings  of  the  26th  Annual 


Military  Testing  Association  Conference 


Munich,  Federal  Republic  of  Germany. 
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Wayne  L.  Waag 


Vaughan,  D.  S.,  Vadrick,  R.  M.,  Perrin,  B.  M.t 
&  Mitchell,  J.  L.  (1985,  May).  Clustering 
tasks  Into  training  modules  in  the  Air 
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ceedings  of  the  5th  Interational  Occupa- 
tional  Analysts  Workshop,  Randolph  AFB,  TX. 

Waag,  W.  1.  (1985).  Status  of  RSD  training 

technology  In  USAF.  Minutes  of  the  UTP-2 
Panel  Meeting  of  the  Technical  Cooperation 
Program,  Ontario,  Canada. 

Ward,  J.  H.,  Jr.,  Treat,  B.  R.,  &  Albert,  W.  A. 
(1985,  5-8  August).  Hierarchical  grouping 
for  nonproportional  regression  systems. 
Proceedings  of  the  American  Statistical 
Association  1985  Joint  Statistical 
Meetings,  Las  Vegas,  NV. 


Weeks,  J.,  &  Arnott,  G.  (1984,  November).  TTIM 
A  causal  model  of  initial-skills  training. 
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of  the  Military  Testing  Association, 
Munich,  Federal  Republic  of  Germany. 


Bobby  R.  Treat 
Walter  A.  Albert 
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job  performance  measurement  research 
program.  Paper  presented  to  the  National 
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Lohman,  D.  F.  (1985,  August).  The  effect  of 
variations  in  speed-accuracy  tradeoff  on 
sex  differences  in  mental  rotation.  Paper 
presented  at  the  93rd  Annual  Convention  of 
the  American  Psychological  Association, 

Los  Angeles,  CA. 

Lohman,  D.  F.,  &  Nichols,  P.  D.  (1985,  April) 
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Operator  Capacity  Limits  in  Complex  Information 
Systems  Workshop  (Part  1).  June  1985. 
Dayton,  OH. 
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TECHNOLOGIES  TRANSITIONED 


MANPOWER  AND  PERSONNEL  DIVISION 

FY8Q  PRODUCTS 

Task  Analysis  Handbook 

Armed  Services  Vocational  Aptitude  Battery 
(ASVAB)  Forms  8,  9,  and  10 


Senior  Executive  Appraisal  System  (SEAS)  and 
General  Manager  Appraisal  System  (GMAS) 

Recruiter  Resource  and  Goal  Allocation  Model 

Organizational  Assessment  Package  (OAP) 

Weighted  Airman  Promotion  System  (WAPS) 
Impact  Analysis 

Enhanced  Likelihood  Function  Estimation 
(LIFE)  Model 

Air  Force  Occupational  Research  Data  Bank 
( ORDB ) 

FY8 1  PRODUCTS 

Job  Performance  Appraisal  System  (JPAS)  and 
Civilian  Potential  Appraisal  System  (CPAS) 

Enlistment  Screening  Test  (EST),  Forms  81A 
and  81B 

Safety  Training  Priorities 

Job  Aptitude  Requirements 

Modification  of  Person-Job-Match  System 

Standardized  Position-Oriented  Training 
System  (SPOTS) 

Mission  Impact  Generalized  Explanatory  Base 
Operating  Support  Model  (GEBOS-M) 

Computer  Adaptive  Testing  (CAT)  Study  on 
Sample  Size  vs  Item  Pool  Size 

Handbook  on  Costs  of  the  First-Term 
Enlisted  Force 


USERS 

Air  Training  Command  (ATC) 

Office  of  the  Assistant  Secretary  of  Defense, 

Manpower,  Reserve  Affairs  &  Logistics  ( OASD/MRASL ) , 
All  Services 

HQ  USAF,  Directorate  of  Civilian  Personnel  (MPK) 

HQ  USAF,  Office  of  Civilian  Personnel  Operations  (OCPO) 

HQ  Air  Force  Recruiting  Service  (USAFRS) 

Leadership  and  Management  Development  Center  (LMDC) 

HQ  USAF,  Directorate  of  Personnel  Plans  (MPX) 

USAFRS 

USAF  Occupational  Measurement  Center  (USAF/OMC) 

USERS 

HQ  USAF/MPK ,  OCPO 

OASD/MRA&L,  All  Services 

Air  Force  Inspection  and  Safety  Center  (AFISC) 

Air  Force  Manpower  and  Personnel  Center  (AFMPC),  ATC 
AFMPC,  ATC 

HQ  USAF,  Directorate  of  Personnel  Programs  (MPP) 

HQ  USAF,  Directorate  of  Manpower  and  Organization  (MPM) 

OASD/MRAAL,  All  Services 

HQ  USAF/MPX 


Air  Force  Officer  Qualifying  Test  (AFOQT) 
Form  0  and  Officer  Screening  Composites 


USAFRS,  Officer  Training  School  (OTS) 

Air  Force  Reserve  Officer  Training  Corps  (AFROTC) 


FY82  PRODUCTS 

Air  Force  Reading  Abilities  Test  (AFRAT) 

National  Labor  Market  Research 

Occupational  Retraining  Guidelines  for 
Retrainee  Management 

Test  Battery  for  Air  Traffic  Controllers 

Physical  Strength  and  Stamina  Requirements 

Enlisted  Assignment/Reassignment  System  (EARS) 

FY83  PRODUCTS 

Modified  Non-Appropriated  Fund  (NAF) 
Supervisory  Appraisal  Form 

Alternative  Weighting  Systems  for  the  WAPS 

Classification  of  Situational  Constraints 
in  Air  Force  Work  Settings 

Enhanced  Hierarchical  Grouping  Computer 
Program  ( H IER-GRP ) 

ASVAB  Forms  11,  12,  and  13 

Historical  Airman  Database  (HAD)  Applications 

FY84  PRODUCTS 

Counselor's  Manual  and  Technical  Supplement 
for  ASVAB  Form  14 

Revised  NAF  Employee  Appraisal  Form;  Revised 
CPAS  Rating  Factors  and  Weights 

Air  Force  Systems  Command  (AFSC)  Incentive 
Awards  Survey 

Relationships  of  ASVAB  Forms  8,  9,  and  10 
and  Air  Force  Technical  School  Grades 

Subgroup  Norms  for  ASVAB  Form  14 


USERS 

ATC,  All  Major  Commands  (MAJCOMs) 

HQ  USAF/MPX 
HQ  USAF/MPP,  AFMPC 

AFMPC,  ATC,  Air  Force  Communications  Command 
Armstrong  Aerospace  Medical  Research  Laboratory  ( AAMRL ) 
HQ  USAF/  MPX ,  AFMPC 

USERS 

OCPO 

HQ  USAF/MPX 
LMDC 

USAF/OMC ,  All  Services 

0ASD/MRA4L ,  All  Services 
HQ  USAF/MPX,  OSD 

USERS 

OASD/MRA&L,  All  Services 

OCPO 

HQ  AFSC/DPC 

AFMPC,  ATC 

OASD/MRAAL 


Validations  of  AFOQT 

Improved  Pilot  Selection  Systems 

Statistical  Study  of  Enlisted  Retention 
Trends 

Procurement  Management  Information  System 
(PROMIS)  R&D 

Validation  of  English  Diagnostic  Test  for 
Journalism-Related  Programs 

Skills  Projection  Analysis 

Improved  Selection  Procedures  for 
Air  Force  Physicians 

Mathematical  and  Statistical  Software  Index 
for  AFHRL  Univac  1100  Computer  System 

Learning  Difficulty  Indices  for  Refinement 
of  Aptitude  Requirements 

Jet  Engine  Mechanic  Job  Performance  Measures 

Development  of  Computerized  Adaptive 
Testing  (CAT)  Item  Pools 

Development  of  1980  Norms  and  Conversion 
Tables  for  the  Enlistment  Screening 
Test  (EST) 

Enhanced  Comprehensive  Occupational  Data 
Analysis  Programs  (CODAP) 

OPERATIONS  TRAINING  DIVISION 

FY80  PRODUCTS 

Simulator  for  Air-to-Air  Combat  (SAAC) 

Visual  Dysfunction  Study 

Interface  Between  SAAC  and  the  Advanced 
Simulator  for  Pilot  Training  (ASPT) 

ASPT  Multiple  Moving  Models  Update 

A  - 1 0  Manual  Reversion  Flight  Control  System 
Simulation  RJD 


AFMPC,  HQ  USAF/MPX ,  OTS,  AFROTC 
ATC 

HQ  USAF/MPX 

AFMPC.  ATC,  USAFRS 

HQ  AFSC/DL 

HQ  USAF/MPM 

Air  Force  Medical  Service  Center 

USAF/OMC,  School  of  Aerospace  Medicine 

AFMPC,  USAF/OMC 

HQ  USAF/MPX,  AFMPC,  OASD/MRAAL.  All  Services 
OASD/MRA&L,  All  Services 

OASD/MRASL ,  All  Services 

USAF/OMC,  All  Services. 

USERS 

Air  Training  Command  (ATC), 

Tactical  Air  Command  (TAC) 

ATC,  TAC 

ATC,  TAC 


ATC,  TAC 


FY81  PRODUCTS 


USERS 


Force  Cue  Requirements  for  A-TO  Alr-to- 
Surface  Weapons  Delivery  Simulation 

Improved  F - 1 6  Back-Up  Fuel  Control  (BuC) 

Restart 

Transfer  of  Training  from  ASPT  to  RED  FLAG 
under  High-Threat  Conditions 

Operational  Test  and  Evaluation  Handbook  for 
Aircrew  Training  Devices 

Measurement  of  In-Flight  Electronic  Warfare 
Officer  (EWO)  Performance 

Visual  Acquisition  of  Air  Combat  Maneuvering 
Targets  in  the  SAAC 

Desk-Top  Trainer  Demonstration 

Linear  Systems  Analysis  of  B-52  Weapons 
Delivery  Accuracy 

Guidelines  for  Management  of  Nonflying 
Intervals  for  Skills  Maintenance 

Surface  Attack  Mission  Simulation 

Recommendations  for  G-Cueing  Devices  In 
Fighter-Type  Simulators 

Vertical  Cue  Requirements  for  Simulated 
Low-Altitude  Flight 

FY82  PRODUCTS 

C-130E  Weapon  System  Trainer  Operational 
Test  and  Evaluation  (0T4E) 

U-2/TR-1  Cockpit  Procedures  Trainer 
( U-2  CPT ) 

Biological  Correlates  of  Pilot  Workload  and  Stress 

Visual  Display  System  Functional  Requirements 

A-10  Combat  Scenario  Development  and  Evaluation: 
Low-Altitude  Simulation  Training 

F-16  Stores  Management  System  (SMS)  Training  Study 


TAC  and  USAF  Tactical  Air  Warfare  Center  (USAF/TAWC) 

ATC,  TAC 

ATC,  TAC 

Air  Force  Operational  Test  and  Evaluation  Center 
(AFOTEC),  MAJCOMs 

Strategic  Air  Command  (SAC) 

TAC 

TAC,  Military  Airlift  Command  (MAC),  SAC 
SAC 

MAJCOMs 

TAC,  Simulator  Systems  Program  Office  (SIMSPO) 

TAC,  SIMSPO 

TAC,  SIMSPO 

USERS 

MAC 

SAC 

Air  Force  Office  of  Scientific  Research  (AFOSR) 
Aeronautical  Systems  Division  (ASD/EN) 

TAC 

TAC,  MAC,  SAC 


F Y83  PRODUCTS 


USERS 


Integrated  Simulator/Airborne  Performance 
Measurement  System  for  C-5A 

Directed  Energy  (Laser)  Flash  Effects  Study 

Comparison  of  Some  Flight  Simulator  Visual 
Displays 

Assessment  of  Workload  and  Prediction  of 
Performance  by  Combined  Psychophysio- 
logical  and  Behavioral  Techniques 

Fiber  Optic  Helmet-Mounted  Display 

Low-Altitude  Data  Base  Development  and 
Evaluation  Research 

Field  of  View  (FOV)  for  Selected  F-16 
Weapons  Delivery  Tasks 

Radar  Warning  Receiver/Electronic  Counter¬ 
measures  Part-Task  Trainer  (RWR/ECM  PTT) 

Generic  Threat  Recognition  Trainer 

FY84  PRODUCTS 

C-130E  Weapon  System  Trainer  Operational  Test  and 
Eva luat ion 

Advanced  Visual  Technology  System 

The  Tactical  Training  Center:  An  Integration  of 
Advanced  Simulator  and  Range  System  Concepts 

A-10  Close  Air  Support  Performance  in  a  Flight 

Simulator:  Effects  of  Visual  Display  Field-of-View 

A  Unitary  Measure  of  Performance  for  the  Close  Air 
Support  Mission 

Aircrew  Training  Task  Surveys 

Investigation  of  Real  Versus  Collimated  Imagery  in 
Flight  Simulator  Visual  Display 

Artificial  Intelligence  Research  in  Pilot 
Training-Visual  Attention 


MAC 

TAC,  Army 
MAJCOMs ,  ASD/EN 

AFOSR,  Arizona  Air  National  Guard 

ASD,  Armstrong  Aeromedical  Research  Laboratory 
(AAMRL),  Army,  Navy 

TAC 

TAC 

TAC,  SAC,  MAC 

SAC 

USERS 

MAC 

Army 

TAC,  Training  Data  Analysis  Center  (TDAC) 

TAC 

TAC 

MAC,  SAC 
ASD,  MAJCOMs 

AFOSR,  Defense  Advanced  Research  Products 
Agency  ( DARPA) 
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LOGISTICS  AND  HUMAN  FACTORS  DIVISION 


FY80  PRODUCTS 

Models  of  Maintenance  Resource  Interactions 

FY8 1  PRODUCTS 

Handbook  for  Selection  of  Format  Options  for  Procure¬ 
ment  of  Tecb^'cal  Data 

Air  Force  Aircraft  Battle  Damage  Repair  Study 

Draft  Military  Specifications  for  Maintenance  Task 
Analysis  and  Logic  Tree  Troubleshooting  Aids 

Sensor  Simulation  for  Target  Acquisition  Training 

FY82  PRODUCTS 

Analysis  to  Improve  the  Maintenance  Environment 

Tactical  Air  Warfare  Center  Support 

Three-Dimensional  Display  for  Training  Weapons 
Directors 

Acquisition  of  Supportable  Systems  Evaluation 
Technology  (ASSET) 

Sneak  Circuit  Analysis  Applied  to  Development  of 
Fault  Isolation  Procedures 

FY83  PRODUCTS 

Unified  Data  Base  Technology 

Logistics  Analyses  for  the  Integrated 
Communications  Navigation  Identification  Avionics 
( ICNIA)  System 

Maintenance  Demand  Metrics  for  Peacetime  Operations 

Analysis  to  Improve  the  Maintenance  Environment 
(Missiles  and  Reserve  Forces) 


USERS 

Air  Force  Wright  Aeronautical  Laboratories  (AFWAL) 

USERS 

Air  Force  Logistics  Command  (AFLC),  Air  Force 
Institute  of  Technology  (AFIT) 

SPOs,  Technical  Order  Management  Agencies  (TOMAs) 

AFLC,  Air  Force  Logistics  and  Engineering  (HQ  AF/LE), 

US  Air  Forces  In  Europe  (USAFE),  ASD, 

Air  Force  Acquisition  Logistics  Division  (AFALD),  AFWAL 

ASD 

ASD 

USERS 

AFLC,  MAJCOMs ,  AF/LE 

USAF/TAWC 

TAC,  ATC 

AFSC ,  ASD,  AFLC,  Army,  Navy 

TAC,  AFALD,  Air  Force  Coordinating  Office  for 

Logistics  Research  (AFCOLR),  AFLC,  ASD,  Air  Force 
Logistics  Management  Center  (AFLMC) 

USERS 

AFALD,  B-l  SPO 
AFWAL 

AFLC,  AFALD,  TAC 

AFLC,  AF/LE,  SAC,  Air  Force  Reserve  (AFRES) 


FY84  PRODUCTS 


USERS 


Pilot  Study  of  Wartime  Demand  Rates  for  Aircraft 
Electronic  Countermeasures  Equipment 

Impact  Analysis  Techniques 

Tactical  Battle  Management  Software  Simulation 
( TBMS )  System 

Tactical  Command  and  Control  Combat  Planning 
and  Attack  Capability  (COMPAC) 

TRAINING  SYSTEMS  DIVISION 

FY60  PRODUCTS 

Writers  Aid  Computer  Program 

Development  and  Validation  of  the 
Learning  Strategies  and  Skills 
Training  Program 

Evaluation  of  the  High-Fidelity  6883 
Maintenance  Simulator 


AFLC ,  AFWAL,  TAC 

AFLC,  AFALD,  AFWAL 

Electronic  Systems  Division  (ESD),  Rome  Air 
Development  Center  (RADC),  USAFE,  TAC 

ESD,  RADC,  USAFE,  TAC 

USERS 

AFSC 

ATC 

SIMSPO,  ATC 


Development  of  the  On-the-Job  Training  HQ  USAF/MPP 

( OJT)  Capacity  Model 

FY81  PRODUCTS  USERS 

A  Testing  and  Instructional  System  Based  ATC 

on  Microterminal  and  Microfiche  Devices 

Computer  Dialog  for  Graphics  Simulation  ASD,  ATC,  MAC,  SAC,  Space  Command 

Programs 

Handbooks  and  Model  Specifications  for  the  ASD,  B-l  SPO,  F-15  SPO,  SIMSPO 

Design  and  Development  of  Maintenance 
Simulators 

Functional  Literacy  Task  Inventory  USAF/MPP 

FY82  PRODUCTS  USERS 

I  Computerized  Adaptive  Measurement  of  ATC,  Army,  Navy 

Achievement 

Forward-Looking  Resource  Scheiuling  (FLRS)  TAC 

Maintenance  Training  Analysis  and  Functional  ASD,  SAC 

Specification  Development  for  a  Mlnuteman 
Maintenance  Training  Simulator 


ATC,  Array,  Navy 


Individualized  Student  Pre-Course  Skill 
Training  for  Computer-Managed  Instruction 


Computer-Ass f sted  Instruction  (CAI)  Course¬ 
ware  Development 


AFMPC,  Department  of  Energy  (DOE),  SAC,  Navy 


Development  of  the  Flat-Panel  6883  Simulator 


ASD,  ATC 


FY83  PRODUCTS 

Improved  USAF  Non-Destructive  Inspection 
Technician  Capabilities 

Personnel  Requirements  for  Non-Conventional 
Instruction 

Development  of  Instructional  Treatment 
Alternatives  Applicable  to  Technical 
Training 

Comparative  Evaluation  of  High-  and  Low- 
Fidelity  6883  Maintenance  Simulators 
with  Actual  Equipment 


Acquiring  Better  Maintenance  Trainers 


SIMSPO,  ATC 


FY84  PRODUCTS 


Instructional  Support  Software  (ISS) 


ATC,  MAJCOMs 


Ada  Manpower  and  Training  Requirements 


Joint  Ada  Program  Office 


Ada  Computer-Aided  Instruction  ( CAI  i 
Courseware  Development 


Joint  Ada  Program  Office 


Integrated  Training  System  (ITS)  for  Air 
Force  OJT 


AFSC ,  TAC 


Development  Procedures  for  Task  Evaluation 
Forms 

CAI  Decision  Handbook 

Field  Evaluation  of  a  Low-Cost  Microcomputer 
Fische-Based  Simulation  System  for  Flight 
Simulator  Troubleshooting  Training 


Computer-Based  Training  (CBT)  Selection 
Assistance  for  Space  Command 


Space  Command 


Intelligent  Systems  Technology 


m.A  a  ?,.*  -J..A 


Maintenance  Training  Simulator  Synthesis 
Study 


S1MSP0 


Graphics/Actual  Equipment  Maintenance 
Training  Study 


SIMSPO,  ATC 


RESEARCH  &  DEVELOPMENT  PROJECT 


POINT  OF  CONTACT 


PHONE 


MANPOWER  AND  PERSONNEL  DIVISION 


Aircrew  Selection  programs  (p.  7) 

Dr.  Jeffrey  E.  Kantor 

(512)  536-3222 
AV:  240-3222 

Air  Force  Enlisted  Retention  Model  (p.  12) 

Mr.  Larry  T.  Looper 

(512)  536-2912 
AV:  240-2912 

Air  Force  Officer  Qualifying  Test  (p.  5) 

Ms.  Jacobina  Skinner 

(512)  536-2257 

AV:  240-2257 

Aptitude  Requirements  (p.  9) 

Mr.  Joseph  L.  Weeks 

(512)  536-3551 
AV:  240-3551 

Armed  Services  Vocational  Aptitude  Battery  (p.  5) 

Dr.  Malcolm  J.  Ree 

(512)  536-3256 
AV:  240-3256 

Basic  Job  Skills  (p.  9) 

Dr.  Sherrie  P.  Gott 

(512)  536-3551 

AV:  240-3551 

Comprehensive  Occupational  Data  Analysis 

Programs  (p.  13) 

Mr .  William  J .  Phalen 

(512)  536-2932 
AV:  240-2932 

Job  Performance  Measurement  (p.  10) 

Dr.  Jerry  W.  Hedge 

(512)  536-3551 
AV:  240-3551 

Learning  Abilities  Measurement  Program  (p.  5) 

Dr.  Raymond  E.  Chrlstal 

(512)  536-3570 

AV:  240-3570 

Person-Job-Match  Technology  (p.  11) 

Dr.  Manuel  Pina,  Jr. 

(512)  536-2242 
AV:  240-2242 

Productivity  (p.  11) 

Dr.  Charles  N.  Weaver 

(512)  536-8418 
AV:  240-8418 

Training  Decisions  System  (p.  14) 

Mr.  Wayne  B.  Archer 

(512)  536-3648 
AV:  240-3648 

Weighted  Airman  Promotion  System  (p.  12) 

OPERATIONS  TRAINING  DIVISION 

Mr.  C.  Deene  Gott 

(512)  536-2512 
AV:  240-2912 

Combat  Mission  Trainer  (p.  21) 

Dr.  Russ  Genet 

(602)  988-6561 

AV:  474-6561 

Electronic  Combat  Training  Effectiveness  (p.  17) 

Dr.  Tom  K i 1 1 1  on 

(602)  988-6561 

AV:  474-6561 

Part-Task  Training  (p.  19) 

Dr.  Bernle  Edwards 

(602)  988-6561 

AV:  474-6561 

Training  Effectiveness  Plan  (p.  16) 

Lt  Col  Roy  Kilgore 

(602)  988-6561 

AV:  474-6561 

LOGISTICS  AND  HUMAN  FACTORS  DIVISION 
Automated  Technical  Information  (p.  31) 

Command/Control  Team  Performance  (p.  29) 

Integrated  Design  Support  (p.  20) 

Integrated  Maintenance  Information  System  (p.  25) 

Maintenance  and  Logistics  in 
Computer-Aided  Design  (p.  20) 

Maintenance  in  Combat  Environments  (p.  27) 

TRAINING  SYSTEMS  DIVISION 

Advanced  On-the-job  Training  System  (p.  37) 

Computer-Aided  Task  Analysis  (p.  30) 

Instructional  Support  Software  System  (p.  35) 

Knowledge  Acquisition/Intelligent  Authoring 
Aids  (p.  36) 

Knowledge  Engineering  (p.  37) 

Operational  Unit  Job  Proficiency  Assessment  (p.  30) 

Speech  Recognition  (p.  36) 

Training  Design  and  Delivery  ROD  (p.  35) 


Capt  Paul  Condit  U  ’)  255-3071 

AV:  705-3071 

Mr.  Bertram  W.  Cream  (513)  255-0607 

AV:  705-0607 

Mr.  T.  N.  Bernstein  (513)  255-6992 

AV:  705-6992 

Capt  Joseph  Von  Holle  (513)  255-2606 

AV:  705-2606 

Mr.  A1  Herner  (513)  255-3071 

AV:  705-3071 

Mr.  Richard  Weimer  (513)  255-2606 

AV:  705-2606 


Maj  Martin  J.  Costellic  (512)  479-2666 

AV:  605-2666 

Maj  Martin  J.  Costellic  (512)  479-2666 

AW:  605-2666 

Dr.  Joe  Y.  Yasutake  (303)  370-7624 

AV:  926-7624 

Capt  Kevin  Klein  (512)  536-3942 

AV:  240-3942 

Dr.  Joe  Y.  Yasutake  (303)  370-7624 

AV:  926-7624 

Dr.  Jerry  W.  Hedge  (512)  240-3551 

AV:  240-3551 

Capt  Terresa  Jackson  (512)  536-3942 

AV:  240-3942 

Col  Gene  Berry  (512)  536-2913 

AV:  240-2913 
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Colonel  Dennis  W.  Jarvl 

Commander 

AFHRL/CC 

Brooks  AFB,  TX  78235-5601 
(512)  536-2665 
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Colonel  Michael  C.  Lane 
Vice  Commander 
AFHRL/CV 

Brooks  AFB,  TX  78235-5601 
(512)  536-3605 
AUTOVON  240-3605 


Dr.  Earl  A.  Allulsl 
Chief  Scientist 
AFHRL/CCN 

Brooks  AFB.  TX  78235-5601 
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AUTOVON  240-3605 


Dr.  Herbert  J.  Clark 

Director,  Plans  &  Programs  Office 
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Captain  Neena  R.  Wright 

Director,  Executive  Support  Office 
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Colonel  Carl  D.  Ellason 

Chief,  Operations  Training  Division 
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Williams  AFB,  AZ  85240-6457 
(602)  988-6561 
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Colonel  Ronald  L.  Kerchner 

Chief,  Manpower  4  Personnel  Division 

AFHRL/MO 
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Chief,  Logistics  4  Human  Factors  Division 

AFHRL/LR 
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Colonel  Gene  A.  Berry 

Chief,  Training  Systems  Division 
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Dr.  Robert  A.  Bottenberg 

Chief,  Technical  Services  Division 
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